00000001:02000400:3.0F:1788263066.135466:0:2977:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788263083.093446:0:3197:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788263084.632270:0:3257:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 795 MB/s 00000001:01000000:2.0:1788263084.882433:0:3257:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 899 MB/s 00000001:01000000:1.0F:1788263085.132932:0:3257:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5647 MB/s 00000020:02000000:0.0F:1788263085.484059:0:3289:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_ga9ee299 00000400:02000000:2.0:1788263086.151183:0:3304:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.129@tcp [8/256/0/180] 00008000:02000000:3.0:1788263089.981007:0:3453:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788263136.315076:0:5254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788263146.562896:0:5833:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263146.562905:0:5833:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788263146.563053:0:5833:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ef37cdc9 00000080:02000400:2.0:1788263146.563067:0:5833:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788263146.568264:0:5833:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788263146.568285:0:5833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788263146.568343:0:5833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000076f321b0) 00000020:00000080:2.0:1788263146.568374:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788263146.607939:0:5833:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788263146.608559:0:5833:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788263146.637284:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788263146.637326:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788263146.637348:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788263146.637396:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788263146.637507:0:5833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788263146.638380:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788263146.638391:0:5833:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788263146.638408:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc5139557f6 00000020:01000004:1.0:1788263146.638911:0:5833:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788263146.638920:0:5833:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788263146.638926:0:5833:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ef37cdc9 from MGS 00000020:01000004:1.0:1788263146.638933:0:5833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788263146.638962:0:5833:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000fe91b741) 00000020:00000080:1.0:1788263146.638979:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788263146.640506:0:5833:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ef37cdc9 from MGS, refs=2 00080000:01000000:1.0:1788263146.640525:0:5833:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788263146.640536:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513955804 00000100:00100000:1.0:1788263146.640699:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788263146.640893:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788263146.640900:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788263146.642332:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788263146.642343:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788263146.643285:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263146.643480:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788263146.643484:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788263146.644968:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788263146.644983:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788263146.657035:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788263146.657060:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788263146.659129:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263146.659133:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263146.659135:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263146.659760:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263146.659763:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263146.659765:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263146.661169:0:5833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788263146.663727:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788263146.911379:0:5833:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2374 MB/s 00000001:01000000:2.0:1788263147.161507:0:5833:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5455 MB/s 00000001:01000000:3.0:1788263147.412823:0:5833:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 812 MB/s 00000001:01000000:3.0:1788263147.664859:0:5833:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 876 MB/s 00080000:10000000:2.0:1788263147.672476:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788263147.689772:0:5833:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788263147.689805:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788263147.689808:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788263147.694736:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788263147.694832:0:5833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788263147.694903:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788263147.695272:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788263147.695300:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788263147.695633:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263147.695833:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788263147.695842:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788263147.701077:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788263147.701096:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788263147.703744:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788263147.703759:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788263147.704627:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788263147.704656:0:5833:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.129@tcp' 00000020:01000004:0.0:1788263147.704658:0:5833:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788263147.704743:0:5833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.129@tcp (typ=mgc) 00000020:00000080:0.0:1788263147.704766:0:5833:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.129@tcp (00000000d72dfe36) 00000020:00000080:0.0:1788263147.704799:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788263147.704894:0:5833:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002cd66a6a@MGC192.168.201.129@tcp: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1788263147.705080:0:5833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.129@tcp-0 is initialized 00000040:01000000:0.0:1788263147.705087:0:5833:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788263147.706810:0:5849:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788263147.706862:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.129@tcp (uuid 33366ce6-2c46-49eb-9afc-8617712bc2f4) 00000020:00000080:3.0:1788263147.706888:0:5833:0:(genops.c:1385:class_connect()) connect: client 33366ce6-2c46-49eb-9afc-8617712bc2f4, cookie 0x1a657bc513955812 00000100:00080000:3.0:1788263147.706903:0:5833:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263147.706910:0:5833:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import 000000002cd66a6a using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263147.706975:0:5833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000099cf09aa x1875129753665664/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263147.706999:0:5833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS 00000020:01000004:3.0:1788263147.707022:0:5833:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788263147.707027:0:5833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788263147.707048:0:5833:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ebae17ac) 00000020:00000080:3.0:1788263147.707064:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788263147.709853:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099cf09aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33366ce6-2c46-49eb-9afc-8617712bc2f4:3319:1875129753665664:0@lo:250: 00000100:00100000:1.0:1788263147.710007:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263147.710125:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753665664 00000100:00100000:1.0:1788263147.710134:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753665664 00000100:00080000:2.0:1788263147.710560:0:5848:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788263147.710890:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263147.710902:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008892a623 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3319:x1875129753665664:12345-0@lo:250: 00010000:00080000:1.0:1788263147.710945:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 33366ce6-2c46-49eb-9afc-8617712bc2f4@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1788263147.710989:0:5844:0:(genops.c:1385:class_connect()) connect: client 33366ce6-2c46-49eb-9afc-8617712bc2f4, cookie 0x1a657bc513955820 00000100:00080000:1.0:1788263147.711832:0:5844:0:(import.c:65:import_set_state_nolock()) 000000006a929966 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263147.711922:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008892a623 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:3319:x1875129753665664:12345-0@lo:250: Request processed in 1019us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263147.711932:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263147.712027:0:3319:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788263147.712037:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.129@tcp: connect to target with instance 0 00000100:00080000:1.0:1788263147.712045:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788263147.712052:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788263147.712055:0:3319:0:(import.c:65:import_set_state_nolock()) 000000002cd66a6a MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788263147.712059:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788263147.712071:0:3319:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788263147.712076:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099cf09aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33366ce6-2c46-49eb-9afc-8617712bc2f4:3319:1875129753665664:0@lo:250: 00010000:00010000:0.0:1788263147.717093:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263147.735826:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263147.736041:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788263147.736048:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788263147.737141:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788263147.737153:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788263147.739756:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788263147.739771:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788263147.741516:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263147.743414:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788263147.743423:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788263147.747778:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788263147.747802:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788263147.836146:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263147.836584:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788263147.836591:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788263147.838311:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788263147.838327:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788263147.839951:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263147.840346:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788263147.840352:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788263147.841322:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788263147.841332:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788263147.843444:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263147.843862:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788263147.843870:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788263147.845587:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788263147.845815:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788263147.846882:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263147.847469:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788263147.847487:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788263147.848910:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788263147.848927:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788263147.904635:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263147.904888:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788263147.904895:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788263147.907443:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788263147.907471:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788263147.908812:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788263147.908824:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788263147.918897:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788263147.918930:0:5833:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788263147.918939:0:5833:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788263147.919106:0:5833:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788263147.919149:0:5833:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788263147.919154:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788263147.919156:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263147.919158:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263147.919158:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263147.919160:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263147.919161:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263147.919162:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263147.919164:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263147.919165:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263147.919166:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263147.919167:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263147.919169:0:5833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263147.919172:0:5833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788263147.919174:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263147.919175:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263147.919176:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263147.919177:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263147.919178:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263147.919179:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263147.919179:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263147.919180:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263147.919181:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263147.919182:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263147.919183:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263147.919184:0:5833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263147.919261:0:5833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788263147.919284:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753665792:0@lo:253: 00000100:00100000:2.0:1788263147.919376:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263147.919450:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aa973d71 going to sleep for 11 seconds 00000100:00100000:0.0:1788263147.919544:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753665792 00000100:00100000:0.0:1788263147.919554:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753665792 00000100:00100000:0.0:1788263147.919611:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263147.919622:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066de635a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:5833:x1875129753665792:12345-0@lo:253: 20000000:01000000:0.0:1788263147.919678:0:5847:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788263147.919682:0:5847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788263147.920387:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788263147.920440:0:5847:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788263147.920792:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263147.921827:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788263147.922268:0:5847:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788263147.922273:0:5847:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788263147.922278:0:5847:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788263147.922292:0:5847:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788263147.922312:0:5847:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788263147.922521:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263147.922744:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788263147.922756:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788263147.922814:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788263147.922860:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788263147.922893:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788263147.922979:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788263147.922988:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788263147.923728:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788263147.923739:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788263147.923769:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788263147.923776:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788263147.923816:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788263147.923861:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788263147.923909:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788263147.923915:0:5847:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788263147.923926:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263147.924638:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788263147.924657:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788263147.924701:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788263147.924738:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788263147.924815:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788263147.924831:0:5847:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788263147.924922:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788263147.924931:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788263147.924974:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788263147.925213:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788263147.925604:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788263147.925620:0:5847:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788263147.925734:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788263147.925749:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788263147.925792:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788263147.925829:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788263147.925983:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788263147.926027:0:5847:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788263147.926034:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788263147.926972:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788263147.928760:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788263147.928810:0:5847:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.129@tcp for mdt 20000000:01000000:2.0:1788263147.928812:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:2.0:1788263147.928849:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788263147.928856:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788263147.928883:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788263147.928890:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:2.0:1788263147.928935:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788263147.928947:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788263147.928977:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788263147.929029:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788263147.929107:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788263147.929111:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788263147.929115:0:5847:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788263147.929127:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788263147.929130:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788263147.929157:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788263147.929160:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788263147.930024:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788263147.930380:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788263147.930423:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788263147.930546:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788263147.930560:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788263147.930562:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788263147.931210:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788263147.931899:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788263147.931943:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788263147.931975:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788263147.932015:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788263147.932018:0:5847:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788263147.932023:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788263147.932026:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788263147.932031:0:5847:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788263147.932039:0:5847:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788263147.932767:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788263147.932911:0:5847:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788263147.943543:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788263147.943596:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788263147.943771:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788263147.943809:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788263147.943835:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943856:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943867:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943872:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943879:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943885:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943890:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a05c6ad already unused, calling callback (0000000093466ede) 00010000:00010000:3.0:1788263147.943894:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943901:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943927:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943933:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263147.943938:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a05c6ad/0x1a657bc513955827 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788263147.943955:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788263148.162262:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066de635a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:5833:x1875129753665792:12345-0@lo:253: Request processed in 242591us (242837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263148.162280:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263148.162506:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753665792:0@lo:253: 10000000:01000000:2.0:1788263148.162523:0:5833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788263148.162527:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263148.162530:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263148.162531:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263148.162533:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788263148.162535:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263148.162536:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263148.162537:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263148.162539:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263148.162540:0:5833:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788263148.162542:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263148.162543:0:5833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788263148.162568:0:5833:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ef37cdc9 from lustre-MDT0000 10000000:01000000:2.0:1788263148.162603:0:5833:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788263148.162607:0:5833:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788263148.162612:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9943473c3370 10000000:01000000:2.0:1788263148.162618:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263148.162628:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9943473c3370 from 1 10000000:01000000:2.0:1788263148.162631:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788263148.162691:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.162704:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.162713:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263148.162733:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753665920:0@lo:101: 00000100:00100000:2.0:1788263148.162790:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.162845:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964915d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788263148.163006:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753665920 00000100:00100000:0.0:1788263148.163014:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753665920 00000100:00100000:0.0:1788263148.163068:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263148.163079:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f749aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+6:5833:x1875129753665920:12345-0@lo:101: 00010000:00010000:0.0:1788263148.163093:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263148.163108:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395582e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.163134:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395582e expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.163144:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395582e expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.163155:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dd53d5bd, rc 0) 00000100:00100000:0.0:1788263148.163203:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f749aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+7:5833:x1875129753665920:12345-0@lo:101: Request processed in 126us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263148.163209:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263148.163329:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753665920:0@lo:101: 00010000:00010000:2.0:1788263148.163342:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.163350:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263148.163402:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666048:0@lo:501: 00000100:00100000:2.0:1788263148.163428:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.163455:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964915d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788263148.163571:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753666048 00000100:00100000:0.0:1788263148.163575:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753666048 00000100:00100000:0.0:1788263148.163600:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263148.163606:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cc7992d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+7:5833:x1875129753666048:12345-0@lo:501: 00000100:00100000:0.0:1788263148.163858:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cc7992d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+7:5833:x1875129753666048:12345-0@lo:501: Request processed in 251us (429us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263148.163866:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263148.164101:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666048:0@lo:501: 10000000:01000000:2.0:1788263148.164130:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788263148.164146:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.164155:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263148.164164:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994350979800 10000000:01000000:2.0:1788263148.164169:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788263148.164173:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff994350979800 10000000:01000000:2.0:1788263148.164176:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788263148.164179:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff994350979800 from 1 10000000:01000000:2.0:1788263148.164181:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788263148.164201:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000fc443c88/0x1a657bc51395583c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.164207:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000fc443c88/0x1a657bc51395583c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.164253:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000fc443c88/0x1a657bc51395583c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263148.164265:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666176:0@lo:101: 00000100:00100000:2.0:1788263148.164380:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.164409:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964915d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788263148.164461:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753666176 00000100:00100000:0.0:1788263148.164466:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753666176 00000100:00100000:0.0:1788263148.164503:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263148.164510:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087e65260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+6:5833:x1875129753666176:12345-0@lo:101: 00010000:00010000:0.0:1788263148.164520:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263148.164531:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b789885/0x1a657bc513955843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395583c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.164547:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b789885/0x1a657bc513955843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395583c expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.164555:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b789885/0x1a657bc513955843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395583c expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.164563:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b789885, rc 0) 00000100:00100000:0.0:1788263148.164589:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087e65260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+7:5833:x1875129753666176:12345-0@lo:101: Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263148.164594:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263148.164758:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666176:0@lo:101: 00010000:00010000:2.0:1788263148.164770:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000fc443c88/0x1a657bc51395583c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.164788:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000fc443c88/0x1a657bc51395583c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263148.164802:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788263148.164813:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000fc443c88/0x1a657bc51395583c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.164819:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000fc443c88/0x1a657bc51395583c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263148.164825:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788263148.164828:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263148.164833:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff994350979800 10000000:01000000:2.0:1788263148.164835:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788263148.164838:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788263148.164840:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788263148.164853:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.164866:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.164872:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263148.164883:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666304:0@lo:101: 00000100:00100000:2.0:1788263148.164907:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.164930:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964915d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788263148.165024:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753666304 00000100:00100000:0.0:1788263148.165029:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753666304 00000100:00100000:0.0:1788263148.165059:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263148.165066:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6143e79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+7:5833:x1875129753666304:12345-0@lo:101: 00010000:00010000:0.0:1788263148.165074:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263148.165082:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395584a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.165108:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395584a expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.165116:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395584a expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.165123:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000633075c, rc 0) 00000100:00100000:0.0:1788263148.165157:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6143e79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+8:5833:x1875129753666304:12345-0@lo:101: Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263148.165162:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263148.165379:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666304:0@lo:101: 00010000:00010000:2.0:1788263148.165389:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.165396:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263148.165444:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666432:0@lo:501: 00000100:00100000:2.0:1788263148.165470:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.165543:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964915d6 going to sleep for 11 seconds 00000100:00100000:1.0:1788263148.165744:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753666432 00000100:00100000:1.0:1788263148.165749:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753666432 00000100:00100000:0.0:1788263148.170187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263148.170249:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d43b40b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+8:5833:x1875129753666432:12345-0@lo:501: 00000100:00100000:0.0:1788263148.170876:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d43b40b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:5833:x1875129753666432:12345-0@lo:501: Request processed in 671us (5403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263148.170886:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263148.170992:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666432:0@lo:501: 00000100:00100000:2.0:1788263148.171049:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666560:0@lo:503: 00000100:00100000:2.0:1788263148.171099:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.171192:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000964915d6 going to sleep for 11 seconds 00000100:00100000:0.0:1788263148.171424:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753666560 00000100:00100000:0.0:1788263148.171433:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753666560 00000100:00100000:0.0:1788263148.171521:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263148.171529:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006976db51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:5833:x1875129753666560:12345-0@lo:503: 00000100:00100000:0.0:1788263148.171710:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006976db51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:5833:x1875129753666560:12345-0@lo:503: Request processed in 183us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263148.171717:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788263148.171796:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cc71972 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666560:0@lo:503: 00000100:00100000:3.0:1788263148.172489:0:5875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea7c7742 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:5875:1875129753666688:0@lo:502: 00000100:00100000:3.0:1788263148.172540:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263148.172577:0:5875:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9f89034 going to sleep for 11 seconds 00000100:00100000:1.0:1788263148.172838:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753666688 00000100:00100000:1.0:1788263148.172845:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753666688 00000100:00100000:1.0:1788263148.172887:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263148.172895:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000787225c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:5875:x1875129753666688:12345-0@lo:502: 00000100:00100000:1.0:1788263148.173080:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000787225c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:5875:x1875129753666688:12345-0@lo:502: Request processed in 186us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263148.173087:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263148.173484:0:5875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea7c7742 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:5875:1875129753666688:0@lo:502: 00000020:01000000:3.0:1788263148.173517:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263148.173531:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263148.173534:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788263148.173539:0:5875:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788263148.173543:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788263148.173559:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000eb5a8423) 00000020:00000080:3.0:1788263148.173588:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788263148.173594:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788263148.173679:0:5875:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788263148.173687:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc51395585f 00000020:00000080:3.0:1788263148.173926:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788263148.173931:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263148.173933:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263148.173938:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788263148.173940:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263148.173942:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263148.173943:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788263148.173945:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788263148.173950:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005c3b7781) 00000020:00000080:3.0:1788263148.173957:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788263148.173959:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788263148.173960:0:5875:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788263148.173962:0:5875:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788263148.173966:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788263148.174000:0:5875:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ef37cdc9 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788263148.174009:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000baf50c0a) 00000020:00000080:3.0:1788263148.174021:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788263148.174057:0:5875:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788263148.174060:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513955874 00000020:00000080:3.0:1788263148.174131:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788263148.174135:0:5875:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788263148.174138:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1a657bc51395587b 00080000:01000000:3.0:1788263148.174141:0:5875:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788263148.174144:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513955882 00080000:10000000:3.0:1788263148.177377:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788263148.177700:0:5875:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788263148.182129:0:5875:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788263148.262813:0:5875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788263148.263530:0:5875:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788263148.265545:0:5875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788263148.265887:0:5875:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788263148.298321:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000814e1e14) 00000020:00000080:0.0:1788263148.298357:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788263148.298452:0:5875:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788263148.298461:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513955890 00000020:00000080:0.0:1788263148.299034:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788263148.300576:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263148.344603:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263148.381152:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263148.406626:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263148.458568:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263148.501893:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788263148.533870:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1a657bc513955897 00000020:00000080:2.0:1788263148.534338:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788263148.534353:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263148.534368:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263148.534371:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788263148.534374:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263148.534379:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263148.534380:0:5875:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263148.534382:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263148.534383:0:5875:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788263148.534386:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263148.534388:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263148.534389:0:5875:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788263148.534391:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263148.534396:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263148.534397:0:5875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788263148.534401:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788263148.534446:0:5875:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788263148.534512:0:5875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075c64845 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:5875:1875129753666816:0@lo:502: 00000100:00100000:2.0:1788263148.534608:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.534665:0:5875:0:(client.c:2715:ptlrpc_set_wait()) set 000000005de92192 going to sleep for 11 seconds 00000100:00100000:0.0:1788263148.534798:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753666816 00000100:00100000:0.0:1788263148.534809:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753666816 00000100:00100000:0.0:1788263148.534872:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263148.534882:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b4a3643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:5875:x1875129753666816:12345-0@lo:502: 00000100:00100000:0.0:1788263148.535258:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b4a3643 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:5875:x1875129753666816:12345-0@lo:502: Request processed in 376us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263148.535267:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263148.535330:0:5875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075c64845 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:5875:1875129753666816:0@lo:502: 00000020:01000000:0.0:1788263148.535362:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263148.535367:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263148.535368:0:5875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788263148.535371:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788263148.535641:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788263148.535666:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788263148.535699:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.535712:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263148.535720:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994350979800 from 1 10000000:01000000:2.0:1788263148.535723:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263148.535757:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.535764:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.535792:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263148.535808:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da6e6d56 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666944:0@lo:101: 00000100:00100000:2.0:1788263148.535847:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.535875:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 000000005de92192 going to sleep for 11 seconds 00000100:00100000:2.0:1788263148.535899:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753666944 00000100:00100000:2.0:1788263148.535904:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753666944 00000100:00100000:2.0:1788263148.535930:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263148.535937:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab26f97a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:5833:x1875129753666944:12345-0@lo:101: 00010000:00010000:2.0:1788263148.535949:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263148.535963:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395589e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.536101:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395589e expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.536114:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395589e expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.536124:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000e817c6f, rc 0) 00000100:00100000:2.0:1788263148.536158:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab26f97a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:5833:x1875129753666944:12345-0@lo:101: Request processed in 222us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263148.536164:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263148.536198:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da6e6d56 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753666944:0@lo:101: 00010000:00010000:2.0:1788263148.536210:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.536259:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263148.537148:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000da6e6d56 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667072:0@lo:256: 00000100:00100000:2.0:1788263148.537199:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.537352:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 000000005de92192 going to sleep for 11 seconds 00000100:00100000:3.0:1788263148.537521:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753667072 00000100:00100000:3.0:1788263148.537529:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753667072 00000100:00100000:3.0:1788263148.537609:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263148.537617:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000478276e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:5833:x1875129753667072:12345-0@lo:256: 20000000:01000000:3.0:1788263148.537638:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788263148.537644:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788263148.537845:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000478276e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:5833:x1875129753667072:12345-0@lo:256: Request processed in 229us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263148.537863:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788263148.537932:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000da6e6d56 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667072:0@lo:256: 10000000:01000000:0.0:1788263148.538578:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788263148.538593:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.538617:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263148.538626:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994350979800 from 1 10000000:01000000:0.0:1788263148.538629:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263148.538695:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.538703:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.538714:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263148.538731:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667200:0@lo:101: 00000100:00100000:0.0:1788263148.538770:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263148.539166:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037c3019e going to sleep for 11 seconds 00000100:00100000:2.0:1788263148.539322:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753667200 00000100:00100000:2.0:1788263148.539331:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753667200 00000100:00100000:2.0:1788263148.539368:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263148.539377:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076770ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:5833:x1875129753667200:12345-0@lo:101: 00010000:00010000:2.0:1788263148.539390:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263148.539407:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139558ac expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.539432:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139558ac expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.539441:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139558ac expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.539451:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008b4a8482, rc 0) 00000100:00100000:2.0:1788263148.539500:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076770ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:5833:x1875129753667200:12345-0@lo:101: Request processed in 123us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263148.539505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263148.539586:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667200:0@lo:101: 00010000:00010000:0.0:1788263148.539601:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.539610:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263148.539667:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667328:0@lo:501: 00000100:00100000:0.0:1788263148.539708:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263148.539733:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037c3019e going to sleep for 11 seconds 00000100:00100000:2.0:1788263148.539849:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753667328 00000100:00100000:2.0:1788263148.539854:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753667328 00000100:00100000:2.0:1788263148.539873:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263148.539877:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b2160e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:5833:x1875129753667328:12345-0@lo:501: 00000100:00100000:2.0:1788263148.540552:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b2160e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:5833:x1875129753667328:12345-0@lo:501: Request processed in 672us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263148.540560:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263148.540868:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667328:0@lo:501: 00000100:00100000:0.0:1788263148.540908:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667456:0@lo:503: 00000100:00100000:0.0:1788263148.540951:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263148.540994:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037c3019e going to sleep for 11 seconds 00000100:00100000:2.0:1788263148.541082:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753667456 00000100:00100000:2.0:1788263148.541088:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753667456 00000100:00100000:2.0:1788263148.541114:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263148.541120:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a182eeba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:5833:x1875129753667456:12345-0@lo:503: 00000040:00080000:2.0:1788263148.541159:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263148.541279:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a182eeba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:5833:x1875129753667456:12345-0@lo:503: Request processed in 158us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263148.541286:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263148.541550:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667456:0@lo:503: 00000040:00080000:3.0:1788263148.542634:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788263148.542885:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788263148.542906:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263148.542976:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.542998:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263148.543053:0:5833:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788263148.543057:0:5833:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994350979800 10000000:01000000:0.0:1788263148.543060:0:5833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994350979800 10000000:01000000:0.0:1788263148.543066:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788263148.543073:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994350979800 from 1 10000000:01000000:0.0:1788263148.543076:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263148.543117:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.543124:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.543136:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263148.543161:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667584:0@lo:101: 00000100:00100000:0.0:1788263148.543293:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263148.543330:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b837e2c going to sleep for 11 seconds 00000100:00100000:2.0:1788263148.543563:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753667584 00000100:00100000:2.0:1788263148.543571:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753667584 00000100:00100000:2.0:1788263148.543621:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263148.543630:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e10e389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:5833:x1875129753667584:12345-0@lo:101: 00010000:00010000:2.0:1788263148.543643:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263148.543658:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139558ba expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.543694:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139558ba expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.543704:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139558ba expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263148.543714:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b6150884, rc 0) 00000100:00100000:2.0:1788263148.543759:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e10e389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5833:x1875129753667584:12345-0@lo:101: Request processed in 129us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263148.543784:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263148.543952:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667584:0@lo:101: 00010000:00010000:0.0:1788263148.543967:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.543975:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263148.544034:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667712:0@lo:501: 00000100:00100000:0.0:1788263148.544059:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263148.544081:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b837e2c going to sleep for 11 seconds 00000100:00100000:2.0:1788263148.544163:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753667712 00000100:00100000:2.0:1788263148.544168:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753667712 00000100:00100000:2.0:1788263148.544199:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788263148.544205:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba3666c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5833:x1875129753667712:12345-0@lo:501: 00000100:00100000:2.0:1788263148.544479:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba3666c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5833:x1875129753667712:12345-0@lo:501: Request processed in 274us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263148.544487:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263148.544601:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667712:0@lo:501: 00000100:00100000:0.0:1788263148.544630:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667840:0@lo:503: 00000100:00100000:0.0:1788263148.544664:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263148.544757:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753667840 00000100:00100000:3.0:1788263148.544763:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753667840 00000100:00100000:3.0:1788263148.544802:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788263148.544807:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006979f855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5833:x1875129753667840:12345-0@lo:503: 00000100:00100000:0.0:1788263148.545561:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b837e2c going to sleep for 11 seconds 00000100:00100000:2.0:1788263148.545622:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006979f855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5833:x1875129753667840:12345-0@lo:503: Request processed in 813us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263148.545630:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263148.545767:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753667840:0@lo:503: 00000100:00100000:3.0:1788263148.546249:0:5881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea7c7742 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:5881:1875129753667968:0@lo:502: 00000100:00100000:3.0:1788263148.546293:0:5881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263148.546312:0:5881:0:(client.c:2715:ptlrpc_set_wait()) set 000000007e4374cc going to sleep for 11 seconds 00000100:00100000:2.0:1788263148.546422:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753667968 00000100:00100000:2.0:1788263148.546429:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753667968 00000100:00100000:2.0:1788263148.546475:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263148.546482:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000630203f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5881:x1875129753667968:12345-0@lo:502: 00000100:00100000:2.0:1788263148.546791:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000630203f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5881:x1875129753667968:12345-0@lo:502: Request processed in 309us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263148.546798:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788263148.546876:0:5881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea7c7742 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:5881:1875129753667968:0@lo:502: 00000020:01000004:0.0:1788263148.546937:0:5881:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788263148.546953:0:5881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000047e207fa) 00000020:00000080:0.0:1788263148.546974:0:5881:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788263148.547078:0:5881:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ef37cdc9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788263148.547083:0:5881:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ef37cdc9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788263148.547085:0:5881:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ef37cdc9 4 00010000:00080000:0.0:1788263148.547123:0:5881:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000077b32875@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1788263148.549849:0:5881:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788263148.550256:0:5881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788263148.550298:0:5881:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788263148.550315:0:5881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1a657bc5139558cf 00000100:00080000:0.0:1788263148.550328:0:5881:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263148.550335:0:5881:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000077b32875 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788263148.550380:0:5881:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007a7d6aba x1875129753668096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788263148.550398:0:5881:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788263148.550549:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753668096:0@lo:38: 00000100:00100000:1.0:1788263148.550644:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263148.553207:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753668096 00000100:00100000:3.0:1788263148.553241:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753668096 00000100:00100000:3.0:1788263148.553298:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263148.553308:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d5fa741 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875129753668096:12345-0@lo:38: 00000100:00100000:2.0:1788263148.553758:0:5881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:5881:1875129753668224:0@lo:502: 00000100:00100000:2.0:1788263148.553831:0:5881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263148.553870:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753668224 00000100:00100000:2.0:1788263148.553874:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753668224 00000100:00100000:2.0:1788263148.553908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263148.553914:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a12787ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5881:x1875129753668224:12345-0@lo:502: 00000100:00100000:2.0:1788263148.554147:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a12787ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5881:x1875129753668224:12345-0@lo:502: Request processed in 231us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263148.554163:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263148.554314:0:5881:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9f89034 going to sleep for 11 seconds 00000100:00100000:2.0:1788263148.554341:0:5881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:5881:1875129753668224:0@lo:502: 00000040:00080000:2.0:1788263148.554372:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788263148.559619:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788263148.559663:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788263148.559697:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.559713:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788263148.559788:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788263148.559792:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788263148.559793:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263148.559795:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263148.559796:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263148.559797:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263148.559798:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263148.559800:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788263148.559802:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788263148.559803:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788263148.559804:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263148.559805:0:5833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788263148.559810:0:5833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788263148.559813:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788263148.559815:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788263148.559816:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263148.559817:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263148.559824:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263148.559825:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263148.559826:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263148.559827:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788263148.559827:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788263148.559828:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788263148.559829:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263148.559830:0:5833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788263148.559870:0:5833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788263148.559894:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a554c2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753668352:0@lo:253: 00000100:00100000:0.0:1788263148.559980:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263148.560168:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037c3019e going to sleep for 11 seconds 00000100:00100000:3.0:1788263148.560427:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d5fa741 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875129753668096:12345-0@lo:38: Request processed in 7117us (9781us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788263148.560440:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263148.560481:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753668352 00000100:00100000:3.0:1788263148.560491:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753668352 00000100:00100000:1.0:1788263148.560605:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788263148.560615:0:3319:0:(import.c:65:import_set_state_nolock()) 0000000077b32875 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263148.560620:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788263148.560623:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a7d6aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753668096:0@lo:38: 00000100:00100000:3.0:1788263148.560686:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263148.560696:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9279953 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5833:x1875129753668352:12345-0@lo:253: 20000000:01000000:3.0:1788263148.560727:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788263148.560743:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788263148.596920:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788263148.596942:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788263148.597121:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788263148.597126:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788263148.597151:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.597175:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395589e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.597184:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.597257:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc51395589e expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263148.597273:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc51395589e expref: 12 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263148.597287:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a011fba pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875129753668480:0@lo:104: 00000100:00100000:0.0:1788263148.597369:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263148.597424:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013a3f875 going to sleep for 11 seconds 00000100:00100000:1.0:1788263148.597498:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753668480 00000100:00100000:1.0:1788263148.597508:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753668480 00000100:00100000:1.0:1788263148.597574:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263148.597584:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b718bd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5868:x1875129753668480:12345-0@lo:104: 00010000:00010000:1.0:1788263148.597597:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.597655:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263148.597661:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b718bd8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5868:x1875129753668480:12345-0@lo:104: Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263148.597668:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788263148.597702:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263148.597708:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.597716:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7957e85 already unused, calling callback (00000000b3efa6e1) 10000000:00010000:1.0:1788263148.597719:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.597727:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263148.597733:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263148.597739:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263148.597778:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.597786:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263148.597815:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.597822:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395589e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.597843:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263148.597845:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263148.597846:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263148.597926:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015ea018d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753668608:0@lo:103: 00000100:00100000:1.0:1788263148.597955:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263148.598147:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753668608 00000100:00100000:1.0:1788263148.598152:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753668608 00010000:00010000:1.0:1788263148.598169:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395589e expref: 13 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263148.598192:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263148.598198:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000019231ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:3321:x1875129753668608:12345-0@lo:103: 00010000:00010000:1.0:1788263148.598209:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263148.598214:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395589e expref: 13 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598268:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc51395589e expref: 13 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598287:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598293:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788263148.598317:0:5837:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001192377s 00010000:00010000:1.0:1788263148.598321:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598327:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598333:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598339:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598343:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000adaaa025 already unused, calling callback (0000000093466ede) 00010000:00010000:1.0:1788263148.598347:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598355:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598362:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598371:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263148.598402:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000019231ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:3321:x1875129753668608:12345-0@lo:103: Request processed in 205us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263148.598407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263148.598456:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015ea018d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753668608:0@lo:103: 00010000:00010000:1.0:1788263148.598488:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e817c6f/0x1a657bc5139558a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc51395589e expref: 12 pid: 5844 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263148.598506:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a011fba pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875129753668480:0@lo:104: 00010000:00010000:1.0:1788263148.598518:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598526:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598532:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263148.598537:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000adaaa025/0x1a657bc5139558d6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263148.606909:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9279953 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:5833:x1875129753668352:12345-0@lo:253: Request processed in 46200us (46915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263148.606931:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788263148.607114:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a554c2f pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:5833:1875129753668352:0@lo:253: 10000000:01000000:0.0:1788263148.607156:0:5833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788263148.607160:0:5833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263148.607162:0:5833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788263148.607163:0:5833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263148.607164:0:5833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263148.607165:0:5833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263148.607166:0:5833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263148.607167:0:5833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263148.607168:0:5833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788263148.607170:0:5833:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788263148.607171:0:5833:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788263148.607173:0:5833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263148.607174:0:5833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788263148.607192:0:5833:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788263148.615449:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263148.616085:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263148.616552:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263148.616815:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263148.617210:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263148.617437:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263148.621320:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263148.621593:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263148.621876:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263148.622145:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263148.622394:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263148.622648:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788263148.675287:0:5833:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788263148.721439:0:5833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788263148.721614:0:5886:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788263148.721620:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788263148.721900:0:5887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788263148.727455:0:5833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788263148.727666:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788263148.728980:0:5833:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788263148.729061:0:5833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788263148.729320:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263148.730624:0:5833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788263148.731635:0:5833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788263148.733921:0:5833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788263148.734573:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788263148.734835:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788263148.736763:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788263148.736931:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788263148.737061:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788263148.737211:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788263148.737413:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788263148.737565:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788263148.737699:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788263148.737864:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788263148.737990:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788263148.738135:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788263148.738325:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788263148.738488:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788263148.738627:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00010000:00010000:3.0:1788263148.739276:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788263148.740294:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788263148.740550:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788263148.740918:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788263148.741375:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788263148.741525:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788263148.741879:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788263148.742118:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788263148.742456:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788263148.742630:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788263148.743159:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788263148.743353:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788263148.743486:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788263148.743639:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788263148.744201:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788263148.744423:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788263148.744551:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788263148.745162:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788263148.745347:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788263148.745527:0:5833:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788263148.747362:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788263148.790426:0:5887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788263148.859296:0:5833:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788263148.859345:0:5833:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb13201ddf988 00100000:10000000:2.0:1788263148.859355:0:5833:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788263148.860849:0:5833:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788263148.860870:0:5833:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788263148.860886:0:5833:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788263148.860916:0:5833:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788263148.864342:0:5887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788263148.864432:0:5887:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788263148.864437:0:5887:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788263149.758972:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263150.795684:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263151.803607:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263152.827574:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263153.282516:0:6129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788263153.851396:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788263153.921891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788263153.921901:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788263153.921905:0:37:0:(import.c:65:import_set_state_nolock()) 0000000077b32875 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263153.921919:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000077b32875 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263153.921944:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000056d91bb6 x1875129753668864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263153.921980:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056d91bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753668864:0@lo:38: 00000100:00100000:1.0:1788263153.922088:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263153.922325:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263153.922334:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015ea018d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753668736:0@lo:400: 00000100:00100000:1.0:1788263153.922369:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263153.922480:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753668864 00000100:00100000:3.0:1788263153.922489:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753668864 00000100:00100000:3.0:1788263153.922530:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263153.922538:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000414944d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1875129753668864:12345-0@lo:38: 00010000:00080000:3.0:1788263153.922566:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1788263153.922608:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1a657bc5139558dd 00000004:00100000:3.0:1788263153.922651:0:5854:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788263153.922776:0:5854:0:(import.c:65:import_set_state_nolock()) 000000005876d2c8 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263153.922835:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000414944d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875129753668864:12345-0@lo:38: Request processed in 296us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263153.922843:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788263153.923292:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000056d91bb6 x1875129753668864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788263153.923309:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788263153.923317:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788263153.923322:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788263153.923324:0:3319:0:(import.c:65:import_set_state_nolock()) 0000000077b32875 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788263153.923330:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056d91bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753668864:0@lo:38: 00000100:00100000:2.0:1788263153.924044:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753668736 00000100:00100000:2.0:1788263153.924053:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753668736 00000100:00100000:2.0:1788263153.924102:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263153.924110:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccca8aff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:3323:x1875129753668736:12345-0@lo:400: 00000100:00100000:2.0:1788263153.924175:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccca8aff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:3323:x1875129753668736:12345-0@lo:400: Request processed in 67us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263153.924182:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263153.924250:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015ea018d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753668736:0@lo:400: 10000000:01000000:1.0:1788263154.427297:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788263154.427307:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994350979800 from 3 10000000:01000000:1.0:1788263154.427312:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788263154.427362:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 0000000065678145/0x1a657bc5139558e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263154.427376:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 0000000065678145/0x1a657bc5139558e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263154.427388:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 0000000065678145/0x1a657bc5139558e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263154.427421:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c785f14a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753668992:0@lo:101: 00000100:00100000:1.0:1788263154.427499:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263154.427555:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000621faf39 going to sleep for 11 seconds 00000100:00100000:3.0:1788263154.427611:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753668992 00000100:00100000:3.0:1788263154.427625:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753668992 00000100:00100000:3.0:1788263154.427683:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263154.427691:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d954888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:5849:x1875129753668992:12345-0@lo:101: 00010000:00010000:3.0:1788263154.427704:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263154.427717:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a05c6ad/0x1a657bc5139558eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139558e4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263154.427740:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a05c6ad/0x1a657bc5139558eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139558e4 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263154.427750:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a05c6ad/0x1a657bc5139558eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139558e4 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263154.427760:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a05c6ad, rc 0) 00000100:00100000:3.0:1788263154.427813:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d954888 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753668992:12345-0@lo:101: Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263154.427820:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788263154.428010:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c785f14a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753668992:0@lo:101: 00010000:00010000:1.0:1788263154.428026:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 0000000065678145/0x1a657bc5139558e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263154.428035:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 0000000065678145/0x1a657bc5139558e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263154.428266:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c785f14a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753669120:0@lo:256: 00000100:00100000:0.0:1788263154.428760:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263154.428796:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000621faf39 going to sleep for 11 seconds 00000100:00100000:1.0:1788263154.428846:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753669120 00000100:00100000:1.0:1788263154.428852:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753669120 00000100:00100000:1.0:1788263154.428890:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788263154.428897:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b95bdd96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753669120:12345-0@lo:256: 20000000:01000000:1.0:1788263154.428916:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263154.428931:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263154.428934:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788263154.429098:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b95bdd96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753669120:12345-0@lo:256: Request processed in 201us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263154.429105:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263154.430466:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c785f14a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753669120:0@lo:256: 10000000:01000000:0.0:1788263154.430539:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788263154.430549:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 0000000065678145/0x1a657bc5139558e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263154.430559:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 0000000065678145/0x1a657bc5139558e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263154.875509:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263155.900011:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263156.923744:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263157.674176:0:6331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc05c25710 20000000:00000080:1.0:1788263157.674196:0:6331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9943464a2000 uarg=0000000000000000 20000000:01000000:1.0:1788263157.674260:0:6331:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788263157.674267:0:6331:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788263157.674276:0:6331:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788263157.674920:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788263157.674932:0:6331:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788263157.679555:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263157.679965:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788263157.680027:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788263157.680078:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788263157.680097:0:6331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788263157.680119:0:6331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263157.680138:0:6331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139558ac expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263157.680146:0:6331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263157.680184:0:6331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139558ac expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263157.680200:0:6331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139558ac expref: 11 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263157.680214:0:6331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053fe247f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1875129753669248:0@lo:104: 00000100:00100000:1.0:1788263157.680328:0:6331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263157.680399:0:6331:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ad13c5b going to sleep for 11 seconds 00000100:00100000:2.0:1788263157.680566:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753669248 00000100:00100000:2.0:1788263157.680575:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753669248 00000100:00100000:2.0:1788263157.680633:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263157.680643:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fecb38a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:6331:x1875129753669248:12345-0@lo:104: 00010000:00010000:2.0:1788263157.680655:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.680717:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263157.680722:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fecb38a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:6331:x1875129753669248:12345-0@lo:104: Request processed in 81us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263157.680729:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788263157.680750:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263157.680755:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.680764:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000007c3a4f6 already unused, calling callback (00000000b3efa6e1) 10000000:00010000:2.0:1788263157.680767:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.680775:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263157.680781:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263157.680787:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788263157.680817:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.680823:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263157.680853:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.680860:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 0000000007c3a4f6/0x1a657bc5139558ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.680877:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263157.680878:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263157.680880:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263157.680898:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753669376:0@lo:103: 00000100:00100000:2.0:1788263157.680927:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263157.680973:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753669376 00000100:00100000:2.0:1788263157.680976:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753669376 00010000:00010000:2.0:1788263157.680993:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139558ac expref: 12 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263157.681015:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263157.681021:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee591810 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:3323:x1875129753669376:12345-0@lo:103: 00010000:00010000:2.0:1788263157.681032:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263157.681036:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139558ac expref: 12 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681046:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139558ac expref: 12 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681062:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681070:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681092:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681099:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681105:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681111:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681116:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000503936c2 already unused, calling callback (0000000093466ede) 00010000:00010000:2.0:1788263157.681119:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681126:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681134:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263157.681144:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263157.681172:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee591810 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:3323:x1875129753669376:12345-0@lo:103: Request processed in 152us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263157.681178:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263157.681249:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753669376:0@lo:103: 00010000:00010000:3.0:1788263157.681719:0:6331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008b4a8482/0x1a657bc5139558b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139558ac expref: 11 pid: 5844 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263157.681734:0:6331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053fe247f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1875129753669248:0@lo:104: 00010000:00010000:3.0:1788263157.681748:0:6331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263157.681756:0:6331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263157.681762:0:6331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263157.681778:0:6331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000503936c2/0x1a657bc5139558f2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263157.947639:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263158.972675:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263159.036070:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c3eedcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753669504:0@lo:400: 00000100:00100000:3.0:1788263159.036143:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e869358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753669632:0@lo:400: 00000100:00100000:3.0:1788263159.038145:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263159.038234:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753669632 00000100:00100000:3.0:1788263159.038244:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753669632 00000100:00100000:3.0:1788263159.038287:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263159.038296:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005747c80d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753669632:12345-0@lo:400: 00000100:00100000:3.0:1788263159.038349:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005747c80d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753669632:12345-0@lo:400: Request processed in 55us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263159.038357:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788263159.038413:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007e869358 x1875129753669632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263159.038427:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e869358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753669632:0@lo:400: 00000100:00100000:2.0:1788263159.038873:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263159.039431:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753669504 00000100:00100000:0.0:1788263159.039438:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753669504 00000100:00100000:0.0:1788263159.039470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263159.039478:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0d4d50b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:3320:x1875129753669504:12345-0@lo:400: 00000100:00100000:0.0:1788263159.039740:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0d4d50b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:3320:x1875129753669504:12345-0@lo:400: Request processed in 263us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263159.039748:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263159.040566:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c3eedcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753669504:0@lo:400: 00010000:00010000:3.0:1788263159.998685:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263161.020233:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263162.043478:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263162.841607:0:6699:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263162.841612:0:6699:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788263162.841739:0:6699:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000010880a8d 00000020:01000004:2.0:1788263162.841756:0:6699:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788263162.841767:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788263162.841781:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000002d4fc5e0) 00000020:00000080:2.0:1788263162.841796:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788263162.857099:0:6699:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788263162.857612:0:6699:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788263162.880187:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788263162.885065:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788263162.885090:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788263162.885123:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788263162.885138:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788263162.885931:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788263162.885949:0:6699:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788263162.885962:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1a657bc513955900 00000020:01000004:3.0:1788263162.885970:0:6699:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788263162.885993:0:6699:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788263162.885997:0:6699:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788263162.886002:0:6699:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788263162.886008:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788263162.886027:0:6699:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000076f78e74) 00000020:00000080:3.0:1788263162.886043:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788263162.887711:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263162.887892:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788263162.887899:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788263162.892408:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788263162.892431:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788263162.893481:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788263162.893490:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788263162.895192:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263162.896792:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788263162.896800:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788263162.899026:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788263162.899038:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788263162.927596:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263162.928026:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788263162.928033:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788263162.938692:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788263162.938713:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788263162.949729:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788263162.951506:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788263162.958801:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263162.958998:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788263162.959013:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788263162.961720:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788263162.961735:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788263163.023796:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263163.024091:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788263163.024096:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788263163.025104:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788263163.025112:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788263163.025650:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788263163.025676:0:6699:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788263163.025684:0:6699:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788263163.047904:0:6699:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788263163.047946:0:6699:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788263163.047950:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788263163.047952:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788263163.047953:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263163.047954:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263163.047955:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263163.047957:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263163.047958:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263163.047960:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263163.047966:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263163.047967:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263163.047968:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263163.047972:0:6699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788263163.047974:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263163.047975:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788263163.047976:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263163.047977:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263163.047978:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263163.047979:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263163.047979:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263163.047980:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263163.047981:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263163.047982:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263163.047983:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263163.048013:0:6699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788263163.048032:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753669760:0@lo:253: 00000100:00100000:2.0:1788263163.048130:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.048284:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 000000002139ed6b going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.048541:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753669760 00000100:00100000:1.0:1788263163.048551:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753669760 00000100:00100000:1.0:1788263163.048646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788263163.048655:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001c7ba59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753669760:12345-0@lo:253: 20000000:01000000:1.0:1788263163.048686:0:5847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788263163.048697:0:5847:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788263163.048703:0:5847:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788263163.048707:0:5847:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788263163.049613:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263163.049851:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788263163.049865:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788263163.049903:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788263163.049911:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788263163.049943:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788263163.049994:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788263163.050339:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788263163.050362:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:1.0:1788263163.050364:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:1.0:1788263163.050396:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788263163.050403:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788263163.050760:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788263163.050770:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:1.0:1788263163.050806:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788263163.050816:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788263163.050849:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788263163.050901:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788263163.051993:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788263163.052016:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:1.0:1788263163.052018:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:1.0:1788263163.052056:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788263163.052065:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788263163.052100:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788263163.052108:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:1.0:1788263163.052156:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788263163.052166:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788263163.052200:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788263163.052493:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788263163.052529:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788263163.052532:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788263163.052536:0:5847:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788263163.052550:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788263163.052553:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788263163.052585:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788263163.052588:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788263163.053042:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788263163.057158:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788263163.057214:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788263163.057576:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788263163.057593:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788263163.057596:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788263163.058604:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788263163.058665:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788263163.058727:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788263163.059027:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788263163.059071:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788263163.059129:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788263163.059142:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788263163.059144:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788263163.059856:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788263163.059921:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788263163.059989:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788263163.060615:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788263163.060677:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788263163.060716:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788263163.060735:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788263163.060738:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788263163.060748:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788263163.060768:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.060787:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395582e expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.060794:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395584a expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.060799:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139558ba expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.060817:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.060857:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139558ba expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.060873:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139558ba expref: 11 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.060888:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a554c2f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875129753669888:0@lo:104: 00000100:00100000:0.0:1788263163.060960:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263163.061021:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc51395584a expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.061029:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc51395584a expref: 11 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.061038:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000040365118 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875129753670016:0@lo:104: 00000100:00100000:0.0:1788263163.061058:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263163.061087:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc51395582e expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.061094:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc51395582e expref: 11 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.061101:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe6c198d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875129753670144:0@lo:104: 00000100:00100000:0.0:1788263163.061120:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.061130:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0ccd500 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.061199:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753669888 00000100:00100000:1.0:1788263163.061209:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753669888 00000100:00100000:1.0:1788263163.061284:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753670016 00000100:00100000:1.0:1788263163.061287:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753670016 00000100:00100000:1.0:1788263163.061296:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753670144 00000100:00100000:1.0:1788263163.061298:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753670144 00000100:00100000:1.0:1788263163.061312:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263163.061320:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f01ecea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:5847:x1875129753669888:12345-0@lo:104: 00010000:00010000:1.0:1788263163.061334:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.061391:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263163.061396:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f01ecea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:5847:x1875129753669888:12345-0@lo:104: Request processed in 78us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.061404:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263163.061581:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263163.061589:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2821ebb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:5847:x1875129753670016:12345-0@lo:104: 00010000:00010000:1.0:1788263163.061604:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.061636:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788263163.061641:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2821ebb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:5847:x1875129753670016:12345-0@lo:104: Request processed in 54us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.061647:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263163.061659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263163.061665:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df71b3bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5847:x1875129753670144:12345-0@lo:104: 00010000:00010000:1.0:1788263163.061671:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.061698:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788263163.061702:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df71b3bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5847:x1875129753670144:12345-0@lo:104: Request processed in 38us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.061707:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263163.061790:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a554c2f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875129753669888:0@lo:104: 00000100:00100000:0.0:1788263163.061808:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000040365118 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875129753670016:0@lo:104: 00000100:00100000:0.0:1788263163.061814:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe6c198d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5847:1875129753670144:0@lo:104: 00010000:00010000:0.0:1788263163.061835:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.061926:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788263163.061934:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.061942:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000013dcef84 already unused, calling callback (00000000b3efa6e1) 10000000:00010000:3.0:1788263163.061945:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.061953:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263163.061961:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263163.061967:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263163.062002:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062008:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263163.062037:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062043:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 0000000013dcef84/0x1a657bc5139558ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062060:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263163.062063:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062068:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edec6f0e already unused, calling callback (00000000b3efa6e1) 10000000:00010000:3.0:1788263163.062076:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062083:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263163.062088:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263163.062093:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263163.062112:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062117:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263163.062122:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062127:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 00000000edec6f0e/0x1a657bc51395584a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062136:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263163.062138:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062144:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e5bc92a0 already unused, calling callback (00000000b3efa6e1) 10000000:00010000:3.0:1788263163.062146:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062151:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263163.062166:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263163.062170:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263163.062182:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062187:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263163.062201:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062207:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 00000000e5bc92a0/0x1a657bc51395582e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062249:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263163.062251:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263163.062253:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263163.062334:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000326ca076 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753670400:0@lo:103: 00000100:00100000:3.0:1788263163.062373:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263163.062408:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263163.062414:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e869358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753670272:0@lo:103: 00000100:00100000:3.0:1788263163.062507:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263163.062549:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009732b81a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753670528:0@lo:103: 00000100:00100000:3.0:1788263163.062571:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263163.062606:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753670400 00000100:00100000:3.0:1788263163.062612:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753670400 00010000:00010000:3.0:1788263163.062634:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395584a expref: 12 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.062666:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753670272 00000100:00100000:3.0:1788263163.062670:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753670272 00010000:00010000:3.0:1788263163.062682:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139558ba expref: 13 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.062691:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753670528 00000100:00100000:3.0:1788263163.062693:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753670528 00010000:00010000:3.0:1788263163.062702:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395582e expref: 14 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.062713:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263163.062718:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a174343e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:3323:x1875129753670400:12345-0@lo:103: 00010000:00010000:3.0:1788263163.062729:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263163.062734:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395584a expref: 14 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062742:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc51395584a expref: 14 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062755:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000633075c/0x1a657bc513955851 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc51395584a expref: 14 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062768:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263163.062797:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a174343e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:3323:x1875129753670400:12345-0@lo:103: Request processed in 79us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263163.062803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263163.062816:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263163.062821:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d06cbb48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:3323:x1875129753670272:12345-0@lo:103: 00010000:00010000:3.0:1788263163.062836:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263163.062839:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139558ba expref: 12 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062847:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139558ba expref: 12 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062857:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b6150884/0x1a657bc5139558c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139558ba expref: 12 pid: 5844 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062866:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263163.062887:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d06cbb48 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:3323:x1875129753670272:12345-0@lo:103: Request processed in 66us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263163.062893:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263163.062905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263163.062910:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002eccada5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:3320:x1875129753670528:12345-0@lo:103: 00010000:00010000:3.0:1788263163.062917:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263163.062921:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395582e expref: 10 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062927:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc51395582e expref: 10 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062935:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dd53d5bd/0x1a657bc513955835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc51395582e expref: 10 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062946:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062953:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062972:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062979:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062985:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062990:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.062995:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a7a3b9f already unused, calling callback (0000000093466ede) 00010000:00010000:3.0:1788263163.062999:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.063006:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.063018:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.063028:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263163.063054:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002eccada5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:3320:x1875129753670528:12345-0@lo:103: Request processed in 144us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263163.063061:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263163.063094:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009732b81a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753670528:0@lo:103: 00000100:00100000:3.0:1788263163.063116:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e869358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753670272:0@lo:103: 00000100:00100000:3.0:1788263163.063123:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000326ca076 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753670400:0@lo:103: 00010000:00010000:3.0:1788263163.063145:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.063152:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.063157:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a7a3b9f/0x1a657bc51395590e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788263163.063169:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1788263163.063528:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263163.071084:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263163.094365:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001c7ba59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+8:6699:x1875129753669760:12345-0@lo:253: Request processed in 45701us (46226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.094388:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263163.094654:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753669760:0@lo:253: 10000000:01000000:2.0:1788263163.094674:0:6699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788263163.094678:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263163.094680:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788263163.094681:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263163.094682:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788263163.094683:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263163.094684:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263163.094685:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263163.094687:0:6699:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788263163.094688:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263163.094689:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788263163.094710:0:6699:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000010880a8d from lustre-OST0000 10000000:01000000:2.0:1788263163.094763:0:6699:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788263163.094768:0:6699:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788263163.094775:0:6699:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9943473c3370 local copy 10000000:01000000:2.0:1788263163.094780:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788263163.094832:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.094849:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.094860:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.094886:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753670656:0@lo:101: 00000100:00100000:2.0:1788263163.094929:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.094993:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051c92941 going to sleep for 11 seconds 00000100:00100000:3.0:1788263163.095129:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753670656 00000100:00100000:3.0:1788263163.095138:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753670656 00000100:00100000:3.0:1788263163.095187:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263163.095196:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddbcbc70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+8:6699:x1875129753670656:12345-0@lo:101: 00010000:00010000:3.0:1788263163.095210:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263163.095350:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099dc636c/0x1a657bc51395591c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955915 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.095374:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099dc636c/0x1a657bc51395591c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955915 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.095384:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099dc636c/0x1a657bc51395591c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955915 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.095393:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099dc636c, rc 0) 00000100:00100000:3.0:1788263163.095502:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddbcbc70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:6699:x1875129753670656:12345-0@lo:101: Request processed in 307us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263163.095508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263163.095730:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753670656:0@lo:101: 00010000:00010000:2.0:1788263163.095741:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.095747:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.095843:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753670784:0@lo:501: 00000100:00100000:2.0:1788263163.095871:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.095897:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051c92941 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.095909:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753670784 00000100:00100000:1.0:1788263163.095914:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753670784 00000100:00100000:3.0:1788263163.095935:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788263163.095950:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b779adb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:6699:x1875129753670784:12345-0@lo:501: 00000100:00100000:3.0:1788263163.096118:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b779adb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:6699:x1875129753670784:12345-0@lo:501: Request processed in 169us (247us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788263163.096124:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263163.096323:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027a74d6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753670784:0@lo:501: 10000000:01000000:2.0:1788263163.096336:0:6699:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788263163.096361:0:6699:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788263163.096365:0:6699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.096372:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.096384:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.096403:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788263163.096491:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99438144e800 00010000:00010000:0.0:1788263163.096492:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263163.096497:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.096505:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000e817c6f already unused, calling callback (00000000b3efa6e1) 10000000:00010000:0.0:1788263163.096508:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.096516:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263163.096548:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263163.096554:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788263163.096560:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788263163.096565:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9943473c3370 10000000:01000000:3.0:1788263163.096567:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788263163.096570:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9943473c3370 from 1 10000000:01000000:3.0:1788263163.096573:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788263163.096574:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.096580:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263163.096591:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000fcfe0a5a/0x1a657bc513955923 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.096597:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000fcfe0a5a/0x1a657bc513955923 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.096604:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000fcfe0a5a/0x1a657bc513955923 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.096611:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.096615:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000326ca076 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671040:0@lo:101: 00010000:00010000:0.0:1788263163.096617:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 000000000e817c6f/0x1a657bc513955915 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a657bc51395591c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.096641:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263163.096647:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263163.096649:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263163.096650:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263163.096659:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753671040 00000100:00100000:3.0:1788263163.096662:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 000000008eb658e6 going to sleep for 11 seconds 00000100:00100000:0.0:1788263163.096663:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753671040 00000100:00100000:0.0:1788263163.096686:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263163.096693:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bbf01b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:6699:x1875129753671040:12345-0@lo:101: 00010000:00010000:0.0:1788263163.096701:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788263163.096705:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788263163.096713:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000adaaa025/0x1a657bc51395592a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955923 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.096716:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe6c198d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753670912:0@lo:103: 00010000:00010000:0.0:1788263163.096728:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000adaaa025/0x1a657bc51395592a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955923 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.096737:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000adaaa025/0x1a657bc51395592a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955923 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.096743:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263163.096744:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000adaaa025, rc 0) 00000100:00100000:0.0:1788263163.096767:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bbf01b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671040:12345-0@lo:101: Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.096771:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753670912 00000100:00100000:0.0:1788263163.096773:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788263163.096774:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753670912 00000100:00100000:3.0:1788263163.096884:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000326ca076 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671040:0@lo:101: 00010000:00010000:3.0:1788263163.096895:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000fcfe0a5a/0x1a657bc513955923 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395592a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.096902:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000fcfe0a5a/0x1a657bc513955923 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc51395592a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263163.096916:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788263163.096931:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000fcfe0a5a/0x1a657bc513955923 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395592a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.096938:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000fcfe0a5a/0x1a657bc513955923 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395592a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263163.096944:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788263163.096947:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263163.096951:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788263163.096953:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788263163.096965:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000f66f540b/0x1a657bc513955931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.096971:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000f66f540b/0x1a657bc513955931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.096977:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000f66f540b/0x1a657bc513955931 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.096988:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000326ca076 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671168:0@lo:101: 00000100:00100000:3.0:1788263163.097005:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263163.097020:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 000000008eb658e6 going to sleep for 11 seconds 00000100:00100000:0.0:1788263163.097034:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753671168 00000100:00100000:0.0:1788263163.097037:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753671168 00000100:00100000:2.0:1788263163.097061:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263163.097068:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027a74d6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:3320:x1875129753670912:12345-0@lo:103: 00010000:00010000:2.0:1788263163.097078:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263163.097088:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000099dc636c/0x1a657bc51395591c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955915 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.097099:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788263163.097100:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263163.097105:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032c424b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671168:12345-0@lo:101: 00010000:00010000:0.0:1788263163.097111:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263163.097119:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007c3a4f6/0x1a657bc513955938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955931 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.097133:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027a74d6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:3320:x1875129753670912:12345-0@lo:103: Request processed in 66us (390us total) trans 0 rc 0/0 00010000:00010000:0.0:1788263163.097136:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007c3a4f6/0x1a657bc513955938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955931 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.097139:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788263163.097143:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007c3a4f6/0x1a657bc513955938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955931 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.097149:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007c3a4f6, rc 0) 00000100:00100000:0.0:1788263163.097191:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032c424b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671168:12345-0@lo:101: Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.097197:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788263163.097200:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe6c198d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753670912:0@lo:103: 00000100:00100000:2.0:1788263163.097279:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000326ca076 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671168:0@lo:101: 00010000:00010000:2.0:1788263163.097286:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000f66f540b/0x1a657bc513955931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.097291:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000f66f540b/0x1a657bc513955931 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.097358:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000027558f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671296:0@lo:501: 00000100:00100000:2.0:1788263163.097376:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263163.097645:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753671296 00000100:00100000:1.0:1788263163.097650:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753671296 00000100:00100000:2.0:1788263163.097659:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab5666e0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.097670:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263163.097675:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aa56584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671296:12345-0@lo:501: 00000100:00100000:1.0:1788263163.097874:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aa56584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671296:12345-0@lo:501: Request processed in 198us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.097882:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788263163.097897:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000027558f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671296:0@lo:501: 00000100:00100000:2.0:1788263163.097924:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000027558f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671424:0@lo:503: 00000100:00100000:2.0:1788263163.097964:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.097985:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab5666e0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263163.098000:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753671424 00000100:00100000:0.0:1788263163.098004:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753671424 00000100:00100000:0.0:1788263163.098064:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263163.098071:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000173b3b05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671424:12345-0@lo:503: 00000100:00100000:0.0:1788263163.098184:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000173b3b05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671424:12345-0@lo:503: Request processed in 114us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.098191:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263163.098206:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000027558f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671424:0@lo:503: 00000040:00080000:3.0:1788263163.098689:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788263163.098736:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e869358 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671552:0@lo:502: 00000100:00100000:3.0:1788263163.098764:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263163.098790:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 000000008eb658e6 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.098874:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753671552 00000100:00100000:1.0:1788263163.098878:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753671552 00000100:00100000:1.0:1788263163.098907:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263163.098913:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009795feb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671552:12345-0@lo:502: 00000100:00100000:1.0:1788263163.099025:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009795feb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671552:12345-0@lo:502: Request processed in 112us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.099031:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788263163.099053:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e869358 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671552:0@lo:502: 00000040:00080000:3.0:1788263163.099560:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788263163.099602:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788263163.099619:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788263163.099644:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788263163.099661:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788263163.099676:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788263163.099695:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e869358 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671680:0@lo:502: 00000100:00100000:3.0:1788263163.099728:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263163.099753:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015cce217 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.099866:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753671680 00000100:00100000:1.0:1788263163.099871:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753671680 00000100:00100000:1.0:1788263163.099903:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788263163.099910:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061caeff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671680:12345-0@lo:502: 00000100:00100000:1.0:1788263163.100068:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061caeff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671680:12345-0@lo:502: Request processed in 159us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.100073:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788263163.100132:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e869358 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671680:0@lo:502: 00000040:00080000:3.0:1788263163.100186:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788263163.100192:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788263163.101624:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788263163.101634:0:6719:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788263163.101639:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263163.101641:0:6719:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788263163.101645:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263163.101658:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000086db5ff) 00000020:00000080:1.0:1788263163.101677:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788263163.101682:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788263163.101749:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000010880a8d from lustre-OST0000, refs=2 00080000:01000000:1.0:1788263163.101754:0:6719:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788263163.101759:0:6719:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1a657bc513955946 00010000:00010000:0.0:1788263163.105704:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788263163.106015:0:6719:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788263163.109395:0:6719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788263163.109724:0:6719:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788263163.117426:0:6719:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788263163.118276:0:6719:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788263163.121644:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788263163.121662:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263163.121670:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263163.121672:0:6719:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788263163.121693:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263163.121699:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263163.121700:0:6719:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788263163.121703:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788263163.121705:0:6719:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788263163.121756:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263163.121760:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263163.121762:0:6719:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788263163.121764:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788263163.122343:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788263163.122373:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788263163.122397:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000f66f540b/0x1a657bc513955931 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.122411:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000f66f540b/0x1a657bc513955931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263163.122424:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99438144e800 from 1 10000000:01000000:2.0:1788263163.122428:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263163.122472:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395594d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.122479:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395594d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.122490:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395594d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.122537:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000027558f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671808:0@lo:101: 00000100:00100000:2.0:1788263163.122617:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.122678:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab5666e0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263163.122820:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753671808 00000100:00100000:3.0:1788263163.122829:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753671808 00000100:00100000:3.0:1788263163.122880:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788263163.122890:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea60eeac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+10:6699:x1875129753671808:12345-0@lo:101: 00010000:00010000:3.0:1788263163.122904:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263163.122918:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067b49fe0/0x1a657bc513955954 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395594d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.122941:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067b49fe0/0x1a657bc513955954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395594d expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.122952:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067b49fe0/0x1a657bc513955954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395594d expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.122963:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067b49fe0, rc 0) 00000100:00100000:3.0:1788263163.123003:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea60eeac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753671808:12345-0@lo:101: Request processed in 115us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263163.123010:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263163.123153:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000027558f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671808:0@lo:101: 00010000:00010000:2.0:1788263163.123168:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395594d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.123177:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000d7957e85/0x1a657bc51395594d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.123428:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000027558f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671936:0@lo:501: 00000100:00100000:2.0:1788263163.123454:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.123529:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab5666e0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263163.125503:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753671936 00000100:00100000:0.0:1788263163.125526:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753671936 00000100:00100000:0.0:1788263163.126347:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788263163.126364:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011341df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753671936:12345-0@lo:501: 00000100:00100000:0.0:1788263163.126732:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011341df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753671936:12345-0@lo:501: Request processed in 373us (3276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.126741:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788263163.126842:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000027558f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753671936:0@lo:501: 00000100:00100000:1.0:1788263163.126900:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a120f7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672064:0@lo:503: 00000100:00100000:1.0:1788263163.128059:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263163.128130:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 00000000931f279c going to sleep for 11 seconds 00000100:00100000:0.0:1788263163.128192:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753672064 00000100:00100000:0.0:1788263163.128201:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753672064 00000100:00100000:0.0:1788263163.128278:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263163.128288:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004977249 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753672064:12345-0@lo:503: 00000100:00100000:0.0:1788263163.128768:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004977249 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753672064:12345-0@lo:503: Request processed in 480us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.128775:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788263163.128876:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a120f7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672064:0@lo:503: 00000040:00080000:1.0:1788263163.129268:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788263163.131537:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a120f7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672192:0@lo:502: 00000100:00100000:1.0:1788263163.131641:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.131854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753672192 00000100:00100000:0.0:1788263163.131863:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753672192 00000100:00100000:0.0:1788263163.131919:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263163.131929:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3832845 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753672192:12345-0@lo:502: 00000100:00100000:0.0:1788263163.132173:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3832845 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753672192:12345-0@lo:502: Request processed in 244us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.132191:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788263163.132628:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 00000000931f279c going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.132657:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a120f7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672192:0@lo:502: 00000040:00080000:1.0:1788263163.132968:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788263163.133029:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788263163.133063:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a120f7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672320:0@lo:502: 00000100:00100000:1.0:1788263163.133122:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263163.133163:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set 00000000931f279c going to sleep for 11 seconds 00000100:00100000:0.0:1788263163.133260:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753672320 00000100:00100000:0.0:1788263163.133267:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753672320 00000100:00100000:0.0:1788263163.133315:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788263163.133324:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a18af263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753672320:12345-0@lo:502: 00000100:00100000:0.0:1788263163.133710:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a18af263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753672320:12345-0@lo:502: Request processed in 387us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.133718:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788263163.133797:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a120f7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672320:0@lo:502: 00000040:00080000:1.0:1788263163.133901:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788263163.133911:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788263163.134902:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263163.134915:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263163.134917:0:6723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788263163.134924:0:6723:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99438144e800 00000020:00000080:0.0:1788263163.134926:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263163.134966:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263163.134969:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263163.134971:0:6723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788263163.134974:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788263163.135114:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788263163.135137:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263163.135158:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.135171:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263163.135214:0:6699:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788263163.135240:0:6699:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99438144e800 10000000:01000000:1.0:1788263163.135243:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99438144e800 10000000:01000000:1.0:1788263163.135248:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788263163.135254:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99438144e800 from 1 10000000:01000000:1.0:1788263163.135266:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788263163.135319:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.135328:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.135340:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.135363:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672448:0@lo:101: 00000100:00100000:1.0:1788263163.135414:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263163.135566:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263163.135626:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753672448 00000100:00100000:0.0:1788263163.135634:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753672448 00000100:00100000:0.0:1788263163.135996:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263163.136006:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753672448:12345-0@lo:101: 00010000:00010000:0.0:1788263163.136020:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263163.136035:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395595b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.136060:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395595b expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.136071:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395595b expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.136089:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340030c00, rc 0) 00000100:00100000:0.0:1788263163.136139:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753672448:12345-0@lo:101: Request processed in 134us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.136145:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263163.136255:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b26300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672448:0@lo:101: 00010000:00010000:0.0:1788263163.136274:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.136284:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.136411:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672576:0@lo:501: 00000100:00100000:0.0:1788263163.136669:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.136702:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943438e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.136745:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753672576 00000100:00100000:1.0:1788263163.136751:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753672576 00000100:00100000:1.0:1788263163.136782:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788263163.136789:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753672576:12345-0@lo:501: 00000100:00100000:1.0:1788263163.137003:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753672576:12345-0@lo:501: Request processed in 213us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.137010:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263163.137072:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672576:0@lo:501: 00000100:00100000:0.0:1788263163.137099:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672704:0@lo:503: 00000100:00100000:0.0:1788263163.137131:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.137150:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943438e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.137195:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753672704 00000100:00100000:1.0:1788263163.137200:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753672704 00000100:00100000:1.0:1788263163.137239:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788263163.137246:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753672704:12345-0@lo:503: 00000100:00100000:1.0:1788263163.137383:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753672704:12345-0@lo:503: Request processed in 137us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.137390:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263163.137623:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672704:0@lo:503: 00000040:00080000:0.0:1788263163.137872:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263163.137931:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672832:0@lo:502: 00000100:00100000:0.0:1788263163.137965:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.138001:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943438e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.138043:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753672832 00000100:00100000:1.0:1788263163.138048:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753672832 00000100:00100000:1.0:1788263163.138088:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788263163.138094:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753672832:12345-0@lo:502: 00000100:00100000:1.0:1788263163.138291:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753672832:12345-0@lo:502: Request processed in 196us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.138297:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263163.138563:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672832:0@lo:502: 00000040:00080000:0.0:1788263163.138797:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788263163.138848:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788263163.138881:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788263163.138922:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788263163.138957:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788263163.139004:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788263163.139042:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788263163.139077:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788263163.139119:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788263163.139153:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788263163.139197:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788263163.139288:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788263163.139592:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788263163.139629:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788263163.139678:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788263163.139717:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788263163.139754:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788263163.139825:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788263163.139860:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788263163.139889:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788263163.139950:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788263163.139987:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788263163.140019:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788263163.140068:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788263163.140104:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788263163.140135:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788263163.140180:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788263163.140982:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788263163.141040:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672960:0@lo:502: 00000100:00100000:0.0:1788263163.141121:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.141240:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943438e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.141723:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753672960 00000100:00100000:1.0:1788263163.141734:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753672960 00000100:00100000:1.0:1788263163.141806:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788263163.141818:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753672960:12345-0@lo:502: 00000100:00100000:1.0:1788263163.142092:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753672960:12345-0@lo:502: Request processed in 275us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.142102:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788263163.142412:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753672960:0@lo:502: 00000040:00080000:0.0:1788263163.142589:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788263163.142601:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788263163.145007:0:6724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788263163.145031:0:6724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9943473c19b8) 00000020:00000080:0.0:1788263163.145057:0:6724:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788263163.145176:0:6724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99438144e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788263163.145180:0:6724:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99438144e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788263163.145296:0:6724:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99438144e800 3 00010000:00080000:0.0:1788263163.145395:0:6724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99437fa2f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1788263163.150614:0:6724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788263163.150937:0:6724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788263163.150975:0:6724:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788263163.150989:0:6724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1a657bc513955970 00000100:00080000:0.0:1788263163.151000:0:6724:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263163.151006:0:6724:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99437fa2f000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788263163.151044:0:6724:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437a588000 x1875129753673088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263163.151116:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753673088:0@lo:38: 00000100:00100000:3.0:1788263163.151195:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.151325:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753673088 00000100:00100000:2.0:1788263163.151334:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753673088 00000100:00100000:2.0:1788263163.151374:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263163.151383:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1875129753673088:12345-0@lo:38: 00010000:00080000:2.0:1788263163.151409:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1788263163.151445:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1a657bc513955977 00000004:00100000:2.0:1788263163.151460:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788263163.151495:0:5853:0:(import.c:65:import_set_state_nolock()) ffff994375d84000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788263163.151591:0:6724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788263163.151657:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753673216:0@lo:400: 00000100:00100000:0.0:1788263163.151690:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.151741:0:5854:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788263163.151749:0:5854:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000040:00080000:0.0:1788263163.152680:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788263163.152792:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788263163.153084:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263163.153107:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.153119:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.153162:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875129753673088:12345-0@lo:38: Request processed in 1776us (1964us total) trans 0 rc 0/0 00000020:01000004:1.0:1788263163.153164:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788263163.153166:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788263163.153167:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263163.153168:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263163.153169:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1788263163.153171:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:1.0:1788263163.153171:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263163.153172:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263163.153174:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788263163.153175:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788263163.153176:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263163.153178:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788263163.153191:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753673216 10000000:01000000:1.0:1788263163.153196:0:6699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000100:00100000:2.0:1788263163.153198:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753673216 00000020:01000004:1.0:1788263163.153198:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788263163.153200:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788263163.153201:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263163.153202:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263163.153202:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263163.153203:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263163.153204:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263163.153205:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788263163.153206:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788263163.153207:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263163.153208:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263163.153250:0:6699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788263163.153253:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263163.153260:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753673216:12345-0@lo:400: 00000100:00100000:1.0:1788263163.153263:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753673344:0@lo:253: 00010000:00080000:3.0:1788263163.153467:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99437a588000 x1875129753673088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263163.153479:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263163.153489:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788263163.153496:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788263163.153501:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788263163.153504:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437fa2f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788263163.153510:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753673088:0@lo:38: 00000100:00100000:2.0:1788263163.153647:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753673216:12345-0@lo:400: Request processed in 386us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.153654:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263163.153668:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263163.153695:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee300 going to sleep for 11 seconds 00010000:00080000:0.0:1788263163.154737:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99437a58aa00 x1875129753673216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263163.154752:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753673216:0@lo:400: 00000100:00100000:0.0:1788263163.154778:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753673344 00000100:00100000:0.0:1788263163.154790:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753673344 00000100:00100000:0.0:1788263163.154847:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263163.154856:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6699:x1875129753673344:12345-0@lo:253: 20000000:01000000:0.0:1788263163.154884:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788263163.154898:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788263163.196090:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788263163.196110:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788263163.196165:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788263163.196171:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788263163.196194:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.196213:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943821f4000/0x1a657bc5139558eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139558e4 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.196235:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.196280:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943821f4000/0x1a657bc5139558eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139558e4 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.196295:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9943821f4000/0x1a657bc5139558eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139558e4 expref: 12 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.196311:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875129753673472:0@lo:104: 00000100:00100000:0.0:1788263163.196375:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.196492:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943438e0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.196641:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753673472 00000100:00100000:1.0:1788263163.196650:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753673472 00000100:00100000:1.0:1788263163.196734:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263163.196744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5868:x1875129753673472:12345-0@lo:104: 00010000:00010000:1.0:1788263163.196758:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc5139558e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.196818:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263163.196825:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5868:x1875129753673472:12345-0@lo:104: Request processed in 83us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.196832:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263163.196893:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875129753673472:0@lo:104: 00010000:00010000:0.0:1788263163.196916:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.197972:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263163.197985:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc5139558e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.198015:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158a00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263163.198019:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc5139558e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.198029:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc5139558e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263163.198037:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc5139558e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263163.198043:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263163.198202:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc5139558e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.198210:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788263163.198288:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753673600:0@lo:103: 00000100:00100000:2.0:1788263163.198354:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263163.198639:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc5139558e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.198649:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc5139558e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139558eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.198666:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263163.198668:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263163.198670:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263163.198784:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753673600 00000100:00100000:2.0:1788263163.198792:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753673600 00010000:00010000:2.0:1788263163.198819:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943821f4000/0x1a657bc5139558eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139558e4 expref: 13 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.198883:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263163.198892:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:3323:x1875129753673600:12345-0@lo:103: 00010000:00010000:2.0:1788263163.198906:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263163.198911:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943821f4000/0x1a657bc5139558eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139558e4 expref: 13 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.198923:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943821f4000/0x1a657bc5139558eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139558e4 expref: 13 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.198937:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f4000/0x1a657bc5139558eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139558e4 expref: 13 pid: 5846 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.198952:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.198960:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788263163.198987:0:5838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002817165s 00010000:00010000:2.0:1788263163.198992:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.199000:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.199006:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.199012:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.199018:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263163.199022:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.199030:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.199050:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.199061:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263163.199105:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc90050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:3323:x1875129753673600:12345-0@lo:103: Request processed in 215us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.199114:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263163.199196:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753673600:0@lo:103: 00010000:00010000:0.0:1788263163.199286:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.199305:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.199311:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031000/0x1a657bc51395597e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.205152:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:6699:x1875129753673344:12345-0@lo:253: Request processed in 50289us (51475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.205170:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788263163.205567:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:6699:1875129753673344:0@lo:253: 10000000:01000000:2.0:1788263163.205587:0:6699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788263163.205597:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263163.205599:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788263163.205601:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263163.205602:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263163.205603:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263163.205604:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263163.205606:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263163.205607:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263163.205608:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263163.205610:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263163.205611:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788263163.205627:0:6699:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788263163.210160:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263163.210347:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788263163.210763:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263163.210943:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788263163.211147:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263163.211808:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788263163.213567:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788263163.430902:0:6699:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788263163.430909:0:6699:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788263163.430940:0:6699:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788263163.430992:0:6699:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788263163.431013:0:6699:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788263163.431040:0:6699:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788263164.095293:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788263164.349351:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788263164.349361:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994350979800 from 21 10000000:01000000:0.0:1788263164.349367:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263164.349422:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.349590:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.349605:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263164.349631:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753673728:0@lo:101: 00000100:00100000:0.0:1788263164.349704:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.349753:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994347cebd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.349777:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753673728 00000100:00100000:0.0:1788263164.349784:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753673728 00000100:00100000:0.0:1788263164.349842:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788263164.349858:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:5849:x1875129753673728:12345-0@lo:101: 00010000:00010000:0.0:1788263164.349871:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263164.349885:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955985 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.349909:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955985 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.349920:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955985 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.349931:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340030800, rc 0) 00000100:00100000:0.0:1788263164.349968:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753673728:12345-0@lo:101: Request processed in 113us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.349986:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788263164.350074:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753673728:0@lo:101: 00010000:00010000:0.0:1788263164.350090:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.350100:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263164.350151:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753673856:0@lo:501: 00000100:00100000:0.0:1788263164.350173:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.350188:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994347cebd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263164.351420:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753673856 00000100:00100000:1.0:1788263164.351432:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753673856 00000100:00100000:1.0:1788263164.351762:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263164.351772:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753673856:12345-0@lo:501: 00000100:00100000:1.0:1788263164.352088:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753673856:12345-0@lo:501: Request processed in 317us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263164.352097:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263164.352164:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753673856:0@lo:501: 00000100:00100000:1.0:1788263164.352250:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753673984:0@lo:503: 00000100:00100000:1.0:1788263164.354155:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263164.354260:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349694a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263164.363829:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753673984 00000100:00100000:2.0:1788263164.363849:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753673984 00000100:00100000:3.0:1788263164.364012:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788263164.364025:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753673984:12345-0@lo:503: 00000100:00100000:3.0:1788263164.364310:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753673984:12345-0@lo:503: Request processed in 288us (10161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.364319:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263164.364553:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753673984:0@lo:503: 00000100:00100000:1.0:1788263164.365061:0:6793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6793:1875129753674112:0@lo:502: 00000100:00100000:1.0:1788263164.365113:0:6793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263164.365184:0:6793:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349694900 going to sleep for 11 seconds 00000100:00100000:2.0:1788263164.365533:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753674112 00000100:00100000:2.0:1788263164.365541:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753674112 00000100:00100000:2.0:1788263164.365618:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263164.365628:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6793:x1875129753674112:12345-0@lo:502: 00000100:00100000:2.0:1788263164.365839:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6793:x1875129753674112:12345-0@lo:502: Request processed in 213us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.365847:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788263164.365919:0:6793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6793:1875129753674112:0@lo:502: 00000100:00100000:0.0:1788263164.365981:0:6793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6793:1875129753674240:0@lo:502: 00000100:00100000:0.0:1788263164.366025:0:6793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.366107:0:6793:0:(client.c:2715:ptlrpc_set_wait()) set ffff994347cebe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263164.366136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753674240 00000100:00100000:1.0:1788263164.366140:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753674240 00000100:00100000:1.0:1788263164.366165:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788263164.366171:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6793:x1875129753674240:12345-0@lo:502: 00000100:00100000:1.0:1788263164.366725:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:6793:x1875129753674240:12345-0@lo:502: Request processed in 552us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263164.366733:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263164.369780:0:6793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6793:1875129753674240:0@lo:502: 00000040:00080000:0.0:1788263164.369874:0:6793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788263164.370037:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788263164.370062:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788263164.370073:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.370085:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263164.370095:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788263164.370099:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994350979800 from 4 10000000:01000000:2.0:1788263164.370102:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263164.370145:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.370161:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.370173:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263164.370194:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674368:0@lo:101: 00000100:00100000:3.0:1788263164.370566:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.370612:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f7049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.370696:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753674368 00000100:00100000:0.0:1788263164.370705:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753674368 00000100:00100000:0.0:1788263164.370758:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788263164.370768:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753674368:12345-0@lo:101: 00010000:00010000:0.0:1788263164.370783:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263164.370798:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955993 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.370823:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955993 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.370835:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955993 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.370845:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340031e00, rc 0) 00000100:00100000:0.0:1788263164.370896:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753674368:12345-0@lo:101: Request processed in 129us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.370903:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788263164.371129:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380633b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674368:0@lo:101: 00010000:00010000:3.0:1788263164.371143:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.371153:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.371238:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674496:0@lo:256: 00000100:00100000:3.0:1788263164.371274:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.371291:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349afd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263164.371307:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753674496 00000100:00100000:3.0:1788263164.371311:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753674496 00000100:00100000:3.0:1788263164.373600:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788263164.373620:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753674496:12345-0@lo:256: 20000000:01000000:3.0:1788263164.373647:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788263164.373663:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788263164.373666:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788263164.373795:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753674496:12345-0@lo:256: Request processed in 181us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.373803:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788263164.375316:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674496:0@lo:256: 10000000:01000000:3.0:1788263164.375376:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788263164.375387:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.375531:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263164.375543:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788263164.375546:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788263164.375549:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788263164.375583:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.375602:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.375612:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.375632:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674624:0@lo:101: 00000100:00100000:3.0:1788263164.375683:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.375724:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349afd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263164.376046:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753674624 00000100:00100000:2.0:1788263164.376053:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753674624 00000100:00100000:2.0:1788263164.376105:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263164.376115:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753674624:12345-0@lo:101: 00010000:00010000:2.0:1788263164.376138:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263164.376152:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139559a1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.376176:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139559a1 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.376188:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139559a1 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.376198:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d000, rc 0) 00000100:00100000:2.0:1788263164.376264:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753674624:12345-0@lo:101: Request processed in 150us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.376282:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788263164.377310:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674624:0@lo:101: 00010000:00010000:3.0:1788263164.377332:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.377344:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.377546:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674752:0@lo:501: 00000100:00100000:3.0:1788263164.377589:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.377630:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349afd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263164.377642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753674752 00000100:00100000:1.0:1788263164.377648:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753674752 00000100:00100000:1.0:1788263164.377685:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788263164.377695:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753674752:12345-0@lo:501: 00000100:00100000:1.0:1788263164.377961:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753674752:12345-0@lo:501: Request processed in 266us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263164.377969:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788263164.378251:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674752:0@lo:501: 00000100:00100000:3.0:1788263164.378283:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674880:0@lo:503: 00000100:00100000:3.0:1788263164.378324:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.378341:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349afd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263164.378420:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753674880 00000100:00100000:1.0:1788263164.378425:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753674880 00000100:00100000:1.0:1788263164.378540:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788263164.378548:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753674880:12345-0@lo:503: 00000100:00100000:1.0:1788263164.378766:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753674880:12345-0@lo:503: Request processed in 218us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263164.378773:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788263164.378884:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753674880:0@lo:503: 00000100:00100000:2.0:1788263164.380417:0:6796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380633480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6796:1875129753675008:0@lo:502: 00000100:00100000:3.0:1788263164.380588:0:6796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.380632:0:6796:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f7046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263164.380782:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753675008 00000100:00100000:2.0:1788263164.380790:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753675008 00000100:00100000:2.0:1788263164.380833:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788263164.380842:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:6796:x1875129753675008:12345-0@lo:502: 00000100:00100000:2.0:1788263164.381104:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:6796:x1875129753675008:12345-0@lo:502: Request processed in 261us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.381113:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788263164.381386:0:6796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380633480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6796:1875129753675008:0@lo:502: 00000020:01000000:3.0:1788263164.381436:0:6796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788263164.381444:0:6796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788263164.381452:0:6796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263164.381454:0:6796:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788263164.381462:0:6796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788263164.381466:0:6796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:3.0:1788263164.381490:0:6796:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788263164.381493:0:6796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788263164.381520:0:6796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99434643b370) 00000020:00000080:3.0:1788263164.381542:0:6796:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788263164.381549:0:6796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788263164.381639:0:6796:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788263164.381645:0:6796:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788263164.381652:0:6796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc5139559b6 00010000:00080000:3.0:1788263164.381689:0:6796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9943472d3000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1788263164.381914:0:6796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788263164.450581:0:6796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788263164.450608:0:6796:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788263164.451279:0:6796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263164.451734:0:6796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263164.451782:0:6796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788263164.451832:0:6796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788263164.452607:0:6799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263164.452613:0:6799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788263164.453204:0:6796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788263164.453253:0:6796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788263164.453289:0:6796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788263164.453315:0:6796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc5139559bd 00000100:00080000:0.0:1788263164.453326:0:6796:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263164.453338:0:6796:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9943472d3000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788263164.453379:0:6796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437a588380 x1875129753675136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788263164.453547:0:6796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788263164.453614:0:6796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263164.453618:0:6796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263164.453620:0:6796:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788263164.453623:0:6796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263164.453628:0:6796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263164.453629:0:6796:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788263164.453632:0:6796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788263164.453635:0:6796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788263164.453666:0:6796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6796:1875129753675264:0@lo:502: 00000100:00100000:0.0:1788263164.453761:0:6796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.453809:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753675264 00000100:00100000:0.0:1788263164.453816:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753675264 00000100:00100000:0.0:1788263164.453858:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788263164.453867:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:6796:x1875129753675264:12345-0@lo:502: 00000100:00100000:2.0:1788263164.454565:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753675392:0@lo:400: 00000100:00100000:2.0:1788263164.454623:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.454669:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263164.454675:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753675520:0@lo:400: 00000100:00100000:2.0:1788263164.454698:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.454731:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753675392 00000100:00100000:2.0:1788263164.454736:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753675392 00000100:00100000:2.0:1788263164.454772:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753675520 00000100:00100000:2.0:1788263164.454775:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753675520 00000100:00100000:2.0:1788263164.454806:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263164.454813:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753675392:12345-0@lo:400: 00000100:00100000:2.0:1788263164.454862:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753675392:12345-0@lo:400: Request processed in 50us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.454870:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263164.454887:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263164.454892:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753675520:12345-0@lo:400: 00000100:00100000:2.0:1788263164.454917:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753675520:12345-0@lo:400: Request processed in 26us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.454922:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788263164.454945:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788263164.454986:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994380631880 x1875129753675520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263164.455000:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753675520:0@lo:400: 00010000:00080000:2.0:1788263164.455011:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994380633800 x1875129753675392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263164.455018:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753675392:0@lo:400: 00000100:00100000:3.0:1788263164.455641:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753675136:0@lo:8: 00000100:00100000:3.0:1788263164.455696:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.455997:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753675136 00000100:00100000:2.0:1788263164.456005:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753675136 00000100:00100000:2.0:1788263164.456046:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263164.456052:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753675136:12345-0@lo:8: 00010000:00080000:2.0:1788263164.456080:0:6702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1788263164.456115:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc5139559c4 00002000:00100000:2.0:1788263164.456167:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff994375d86000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788263164.456172:0:6702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788263164.456177:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788263164.456353:0:6702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788263164.458756:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788263164.458798:0:6702:0:(import.c:65:import_set_state_nolock()) ffff994375d81000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263164.458916:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875129753675136:12345-0@lo:8: Request processed in 2860us (3217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.458928:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788263164.459012:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437a588380 x1875129753675136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263164.459025:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263164.459035:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788263164.459044:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788263164.459054:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788263164.459056:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9943472d3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788263164.459070:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788263164.459075:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753675136:0@lo:8: 00000100:00100000:2.0:1788263164.459992:0:6796:0:(client.c:2715:ptlrpc_set_wait()) set ffff994347ceb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.461198:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:6796:x1875129753675264:12345-0@lo:502: Request processed in 7326us (7432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.461212:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:0.0:1788263164.461290:0:6799:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788263164.461487:0:6799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 191249268164ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788263164.464162:0:6796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6796:1875129753675264:0@lo:502: 00000020:01000000:2.0:1788263164.465483:0:6796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263164.465505:0:6796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263164.465509:0:6796:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788263164.465514:0:6796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788263164.465588:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788263164.465609:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788263164.465620:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.465632:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263164.465644:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263164.465647:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994350979800 from 1 10000000:01000000:2.0:1788263164.465650:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263164.465691:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.465700:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.465712:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263164.465751:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753675648:0@lo:101: 00000100:00100000:2.0:1788263164.465820:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.465867:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263164.466509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753675648 00000100:00100000:1.0:1788263164.466517:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753675648 00000100:00100000:1.0:1788263164.466565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788263164.466576:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753675648:12345-0@lo:101: 00010000:00010000:1.0:1788263164.466590:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263164.466606:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139559cb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.466632:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139559cb expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.466644:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139559cb expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.466654:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158400, rc 0) 00000100:00100000:1.0:1788263164.466719:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753675648:12345-0@lo:101: Request processed in 143us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263164.466726:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788263164.467602:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380633800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753675648:0@lo:101: 00010000:00010000:3.0:1788263164.467626:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.467639:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.467719:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753675776:0@lo:501: 00000100:00100000:3.0:1788263164.467758:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.467789:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943438f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263164.467806:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753675776 00000100:00100000:3.0:1788263164.467811:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753675776 00000100:00100000:3.0:1788263164.467848:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788263164.467855:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753675776:12345-0@lo:501: 00000100:00100000:3.0:1788263164.468116:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753675776:12345-0@lo:501: Request processed in 260us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.468123:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788263164.468159:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753675776:0@lo:501: 00000100:00100000:3.0:1788263164.468187:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753675904:0@lo:503: 00000100:00100000:3.0:1788263164.468239:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.468252:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943438f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263164.468262:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753675904 00000100:00100000:3.0:1788263164.468266:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753675904 00000100:00100000:3.0:1788263164.468284:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788263164.468290:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753675904:12345-0@lo:503: 00000100:00100000:2.0:1788263164.475791:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753675904:12345-0@lo:503: Request processed in 7492us (7542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.475807:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788263164.477272:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753675904:0@lo:503: 00000100:00100000:3.0:1788263164.482889:0:6801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6801:1875129753676032:0@lo:502: 00000100:00100000:3.0:1788263164.482993:0:6801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.483048:0:6801:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.483119:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753676032 00000100:00100000:0.0:1788263164.483127:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753676032 00000100:00100000:0.0:1788263164.483177:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788263164.483186:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:6801:x1875129753676032:12345-0@lo:502: 00000100:00100000:0.0:1788263164.483603:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:6801:x1875129753676032:12345-0@lo:502: Request processed in 416us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.483618:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788263164.483680:0:6801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6801:1875129753676032:0@lo:502: 00000020:01000000:0.0:1788263164.483713:0:6801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263164.483724:0:6801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263164.483727:0:6801:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788263164.483735:0:6801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994350979800 00000020:00000080:0.0:1788263164.483737:0:6801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788263164.483764:0:6801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6801:1875129753676160:0@lo:502: 00000100:00100000:0.0:1788263164.484062:0:6801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.484091:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753676160 00000100:00100000:0.0:1788263164.484097:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753676160 00000100:00100000:0.0:1788263164.484121:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788263164.484128:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:6801:x1875129753676160:12345-0@lo:502: 00000100:00100000:0.0:1788263164.484276:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:6801:x1875129753676160:12345-0@lo:502: Request processed in 147us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.484283:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788263164.484320:0:6801:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435081d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.484332:0:6801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:6801:1875129753676160:0@lo:502: 00000020:01000000:0.0:1788263164.484352:0:6801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263164.484357:0:6801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263164.484359:0:6801:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788263164.484363:0:6801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788263164.484786:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788263164.484805:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263164.484822:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.484835:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263164.484845:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788263164.484848:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9943473c3370 from 1 10000000:01000000:3.0:1788263164.484851:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788263164.484882:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.484890:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.484899:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.484916:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753676288:0@lo:101: 00000100:00100000:3.0:1788263164.484952:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.484977:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.485029:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753676288 00000100:00100000:0.0:1788263164.485035:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753676288 00000100:00100000:0.0:1788263164.485108:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788263164.485117:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753676288:12345-0@lo:101: 00010000:00010000:0.0:1788263164.485127:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263164.485146:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139559d9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.485168:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139559d9 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.485179:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139559d9 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263164.485187:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340030e00, rc 0) 00000100:00100000:0.0:1788263164.485255:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753676288:12345-0@lo:101: Request processed in 139us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.485261:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788263164.489152:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753676288:0@lo:101: 00010000:00010000:3.0:1788263164.489186:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.489200:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.489324:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753676416:0@lo:501: 00000100:00100000:3.0:1788263164.489724:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.489927:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a5739c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263164.491559:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753676416 00000100:00100000:1.0:1788263164.491575:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753676416 00000100:00100000:1.0:1788263164.491630:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788263164.491640:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753676416:12345-0@lo:501: 00000100:00100000:1.0:1788263164.491866:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753676416:12345-0@lo:501: Request processed in 226us (2141us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263164.491876:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788263164.492194:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753676416:0@lo:501: 10000000:01000000:3.0:1788263164.492253:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788263164.492265:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.492277:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263164.495289:0:6800:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788263164.495325:0:6800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875129753676672:0@lo:7: 00000100:00100000:0.0:1788263164.497819:0:6800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.497872:0:6800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435081d180 going to sleep for 11 seconds 00000004:00080000:0.0:1788263164.497894:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788263164.497947:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753676544:0@lo:13: 00000100:00100000:0.0:1788263164.497998:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.498050:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753676544 00000100:00100000:0.0:1788263164.498058:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753676544 00000100:00100000:0.0:1788263164.498128:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263164.498138:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753676544:12345-0@lo:13: 00002000:00000024:0.0:1788263164.498178:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788263164.498247:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753676544:12345-0@lo:13: Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.498254:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788263164.498322:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437a589f80 x1875129753676544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263164.498342:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753676544:0@lo:13: 00000100:00100000:1.0:1788263164.498439:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753676672 00000100:00100000:1.0:1788263164.498444:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753676672 00000100:00100000:1.0:1788263164.498476:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263164.498483:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6800:x1875129753676672:12345-0@lo:7: 00000100:00080000:3.0:1788263164.501867:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788263164.511157:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788263164.511165:0:6705:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788263164.511294:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6800:x1875129753676672:12345-0@lo:7: Request processed in 12806us (13477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263164.511306:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788263164.511636:0:6800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437a58b480 x1875129753676672/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788263180 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263164.511653:0:6800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875129753676672:0@lo:7: 00000004:00080000:3.0:1788263164.511667:0:6800:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788263164.511713:0:6800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875129753676800:0@lo:5: 00000100:00100000:3.0:1788263164.511752:0:6800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.511810:0:6800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263164.511876:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753676800 00000100:00100000:1.0:1788263164.511884:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753676800 00000100:00100000:1.0:1788263164.511972:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263164.511982:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6800:x1875129753676800:12345-0@lo:5: 00002000:00080000:1.0:1788263164.512008:0:6702:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788263164.512012:0:6702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788263164.512259:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6800:x1875129753676800:12345-0@lo:5: Request processed in 277us (505us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788263164.512266:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788263164.515568:0:6800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9943473ddf80 x1875129753676800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263180 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263164.515591:0:6800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875129753676800:0@lo:5: 00000004:00080000:1.0:1788263164.515607:0:6800:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788263164.515654:0:6800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875129753676928:0@lo:700: 00000100:00100000:1.0:1788263164.515719:0:6800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263164.515770:0:6800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263164.515796:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753676928 00000100:00100000:2.0:1788263164.515804:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753676928 00000100:00100000:2.0:1788263164.515862:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263164.515872:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6800:x1875129753676928:12345-0@lo:700: 00000100:00100000:2.0:1788263164.515908:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1875129753677056:0@lo:700: 00000100:00100000:2.0:1788263164.515938:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.515969:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f7040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263164.516132:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753677056 00000100:00100000:3.0:1788263164.516137:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753677056 00000100:00100000:3.0:1788263164.516170:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263164.516177:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1875129753677056:12345-0@lo:700: 40000000:02000000:2.0:1788263164.541341:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788263164.545612:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1875129753677056:12345-0@lo:700: Request processed in 29427us (29665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.545631:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788263164.545720:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994380631880 x1875129753677056/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788263180 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263164.545738:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1875129753677056:0@lo:700: 40000000:02000000:1.0:1788263164.545753:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1788263164.627720:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6800:x1875129753676928:12345-0@lo:700: Request processed in 111838us (111989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263164.627766:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788263164.627863:0:6800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994346b24380 x1875129753676928/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788263180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263164.627883:0:6800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b24380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875129753676928:0@lo:700: 00000001:00080000:3.0:1788263164.627994:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788263164.628023:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1788263164.655828:0:6800:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788263164.661356:0:6800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875129753677184:0@lo:5: 00000100:00100000:2.0:1788263164.661464:0:6800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.661566:0:6800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f7049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.661757:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753677184 00000100:00100000:0.0:1788263164.661766:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753677184 00000100:00100000:0.0:1788263164.661830:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263164.661843:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6800:x1875129753677184:12345-0@lo:5: 00002000:00080000:3.0:1788263164.672683:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788263164.672711:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788263164.678364:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380630000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6800:x1875129753677184:12345-0@lo:5: Request processed in 16513us (16894us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788263164.678393:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788263164.678468:0:6800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994380630a80 x1875129753677184/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263164.678485:0:6800:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788263164.678517:0:6800:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff994380630a80 x1875129753677184/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263180 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263164.678530:0:6800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875129753677184:0@lo:5: 00000004:00080000:3.0:1788263164.678550:0:6800:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788263165.117426:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263166.148675:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263167.164388:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263168.187521:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263169.216445:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788263169.468204:0:7072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788263169.787622:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263169.787652:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753677312:0@lo:13: 00000100:00100000:1.0:1788263169.787749:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.787829:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753677312 00000100:00100000:1.0:1788263169.787837:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753677312 00000100:00100000:1.0:1788263169.787894:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263169.787903:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753677312:12345-0@lo:13: 00002000:00000024:1.0:1788263169.787957:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263169.788016:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753677312:12345-0@lo:13: Request processed in 115us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.788024:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788263169.788044:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788263169.788074:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9943473ddf80 x1875129753677312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263169.788095:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753677312:0@lo:13: 00000100:00100000:0.0:1788263169.790767:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753677440:0@lo:400: 00000100:00100000:0.0:1788263169.790845:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263169.790889:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263169.790895:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753677568:0@lo:400: 00000100:00100000:0.0:1788263169.790960:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263169.790986:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263169.790993:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753677696:0@lo:400: 00000100:00100000:0.0:1788263169.791022:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263169.791053:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753677568 00000100:00100000:0.0:1788263169.791060:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753677568 00000100:00100000:0.0:1788263169.791100:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753677696 00000100:00100000:0.0:1788263169.791103:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753677696 00000100:00100000:0.0:1788263169.791133:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263169.791143:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753677568:12345-0@lo:400: 00000100:00100000:0.0:1788263169.791209:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753677568:12345-0@lo:400: Request processed in 68us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263169.791241:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263169.791264:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263169.791271:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753677696:12345-0@lo:400: 00000100:00100000:0.0:1788263169.791553:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753677696:12345-0@lo:400: Request processed in 281us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263169.791569:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788263169.791610:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437a58b800 x1875129753677568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263169.791624:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753677568:0@lo:400: 00000100:00100000:1.0:1788263169.791785:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753677440 00000100:00100000:1.0:1788263169.791791:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753677440 00000100:00100000:1.0:1788263169.791823:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788263169.791832:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3320:x1875129753677440:12345-0@lo:400: 00000100:00100000:1.0:1788263169.791873:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3320:x1875129753677440:12345-0@lo:400: Request processed in 42us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.791879:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788263169.791908:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263169.792244:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753677440:0@lo:400: 00010000:00080000:2.0:1788263169.795499:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437a58b480 x1875129753677696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263169.795520:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753677696:0@lo:400: 00000001:00080000:0.0:1788263169.839659:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788263170.243896:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263171.260076:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263172.287437:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263173.310159:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263174.331460:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263174.907671:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753677824:0@lo:400: 00000100:00100000:3.0:1788263174.907748:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263174.907802:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263174.907808:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753678208:0@lo:400: 00000100:00100000:3.0:1788263174.907836:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263174.907868:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753677952:0@lo:400: 00000100:00100000:3.0:1788263174.907896:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263174.907914:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263174.907920:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753678080:0@lo:400: 00000100:00100000:3.0:1788263174.907941:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263174.907991:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753677824 00000100:00100000:3.0:1788263174.908000:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753677824 00000100:00100000:3.0:1788263174.908043:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788263174.908052:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3323:x1875129753677824:12345-0@lo:400: 00000100:00100000:3.0:1788263174.908099:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3323:x1875129753677824:12345-0@lo:400: Request processed in 47us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263174.908121:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788263174.908156:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753678208 00000100:00100000:3.0:1788263174.908161:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753678208 00000100:00100000:3.0:1788263174.908196:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263174.908203:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753678208:12345-0@lo:400: 00000100:00100000:3.0:1788263174.908257:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753678208:12345-0@lo:400: Request processed in 55us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263174.908264:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788263174.908284:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788263174.908554:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9943473dd880 x1875129753678208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263174.908565:0:3323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788263174.908581:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753678208:0@lo:400: 00000100:00100000:3.0:1788263174.908591:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753677824:0@lo:400: 00000100:00100000:1.0:1788263174.909574:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753677952 00000100:00100000:1.0:1788263174.909584:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753677952 00000100:00100000:1.0:1788263174.909623:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753678080 00000100:00100000:1.0:1788263174.909625:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753678080 00000100:00100000:1.0:1788263174.909652:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263174.909659:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753677952:12345-0@lo:400: 00000100:00100000:1.0:1788263174.909715:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753677952:12345-0@lo:400: Request processed in 57us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263174.909721:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263174.909746:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263174.909751:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753678080:12345-0@lo:400: 00000100:00100000:1.0:1788263174.909775:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753678080:12345-0@lo:400: Request processed in 24us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263174.909780:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788263174.909871:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788263174.909898:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9943473df800 x1875129753678080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263174.909911:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753678080:0@lo:400: 00010000:00080000:3.0:1788263174.909921:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9943473df100 x1875129753677952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263174.909929:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753677952:0@lo:400: 00000100:00100000:0.0:1788263174.910398:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263174.910412:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753678336:0@lo:13: 00000100:00100000:0.0:1788263174.910451:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263174.910482:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753678336 00000100:00100000:0.0:1788263174.910487:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753678336 00000100:00100000:0.0:1788263174.910516:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263174.910523:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753678336:12345-0@lo:13: 00002000:00000024:0.0:1788263174.910551:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263174.910584:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753678336:12345-0@lo:13: Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263174.910590:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788263174.910616:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437a58b800 x1875129753678336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263174.910630:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753678336:0@lo:13: 00010000:00010000:2.0:1788263175.355497:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263176.381676:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263177.404419:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263178.427621:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263179.453055:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788263179.984482:0:7644:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788263179.984486:0:7644:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788263179.984627:0:7644:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994375782000 00000020:01000004:3.0:1788263179.984647:0:7644:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788263179.984665:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788263179.984681:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff994346438000) 00000020:00000080:3.0:1788263179.984705:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788263180.001452:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788263180.001732:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788263180.024861:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00000100:00100000:1.0:1788263180.027392:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753678464:0@lo:13: 00000100:00100000:1.0:1788263180.027475:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.027580:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753678464 00000100:00100000:2.0:1788263180.027588:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753678464 00000100:00100000:2.0:1788263180.027650:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263180.027659:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753678464:12345-0@lo:13: 00002000:00000024:2.0:1788263180.027688:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788263180.027953:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263180.029062:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753678464:12345-0@lo:13: Request processed in 1400us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.029072:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263180.031271:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753678592:0@lo:400: 00000100:00100000:2.0:1788263180.031355:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.032103:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753678592 00000100:00100000:0.0:1788263180.032113:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753678592 00000100:00100000:0.0:1788263180.032338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788263180.032357:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3321:x1875129753678592:12345-0@lo:400: 00000100:00100000:0.0:1788263180.032431:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3321:x1875129753678592:12345-0@lo:400: Request processed in 76us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.032438:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00100000:10000000:3.0:1788263180.033064:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788263180.033096:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788263180.033169:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788263180.033195:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00010000:00080000:1.0:1788263180.033333:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437a58b800 x1875129753678464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263180.033359:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753678464:0@lo:13: 00000020:00000080:3.0:1788263180.033568:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788263180.033580:0:7644:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788263180.033592:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1a657bc5139559ee 00000020:01000004:3.0:1788263180.033600:0:7644:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788263180.033622:0:7644:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788263180.033626:0:7644:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788263180.033632:0:7644:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788263180.033652:0:7644:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788263180.033657:0:7644:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:1.0:1788263180.036447:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753678720:0@lo:400: 00000100:00100000:1.0:1788263180.036522:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263180.036580:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753678720 00000100:00100000:1.0:1788263180.036599:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753678720 00000100:00100000:0.0:1788263180.037072:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753678592:0@lo:400: 00000100:00100000:2.0:1788263180.037380:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753678848:0@lo:400: 00000100:00100000:2.0:1788263180.037419:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.037502:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753678848 00000100:00100000:0.0:1788263180.037507:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753678848 00000100:00080000:2.0:1788263180.037569:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263180.037831:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263180.037842:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753678720:12345-0@lo:400: 00000100:00100000:1.0:1788263180.038718:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753678720:12345-0@lo:400: Request processed in 876us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.038728:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263180.041316:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263180.041333:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753678848:12345-0@lo:400: 00010000:00080000:1.0:1788263180.041403:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994346b27b80 x1875129753678720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263180.041418:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753678720:0@lo:400: 00000100:00100000:0.0:1788263180.041422:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753678848:12345-0@lo:400: Request processed in 95us (4002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.041428:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788263180.041462:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437a588000 x1875129753678848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263180.041473:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753678848:0@lo:400: 00000040:01000000:3.0:1788263180.054672:0:7644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788263180.054717:0:7644:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788263180.054721:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788263180.054723:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263180.054725:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263180.054726:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263180.054727:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263180.054728:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263180.054730:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263180.054731:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788263180.054733:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788263180.054734:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263180.054735:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263180.054745:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788263180.054747:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263180.054748:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263180.054749:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263180.054750:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263180.054750:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263180.054751:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263180.054752:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263180.054753:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788263180.054754:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788263180.054755:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263180.054756:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263180.054791:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788263180.054810:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753678976:0@lo:253: 00000100:00100000:3.0:1788263180.054960:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263180.055307:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372216600 going to sleep for 11 seconds 00000100:00100000:1.0:1788263180.055416:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753678976 00000100:00100000:1.0:1788263180.055425:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753678976 00000100:00100000:1.0:1788263180.055528:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788263180.055547:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:7644:x1875129753678976:12345-0@lo:253: 20000000:01000000:1.0:1788263180.055585:0:5846:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788263180.055589:0:5846:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788263180.055595:0:5846:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788263180.055599:0:5846:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788263180.057645:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263180.057815:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788263180.057828:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788263180.057858:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788263180.057865:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788263180.057957:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788263180.058052:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788263180.058657:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788263180.058680:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:1.0:1788263180.058683:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:1.0:1788263180.058710:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788263180.058716:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788263180.058742:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788263180.058746:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:1.0:1788263180.058762:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788263180.058767:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788263180.058782:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788263180.058806:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788263180.060474:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788263180.060504:0:5846:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:1.0:1788263180.060507:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:1.0:1788263180.060546:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788263180.060554:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788263180.060604:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788263180.060612:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:1.0:1788263180.060643:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788263180.060659:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788263180.060708:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788263180.060750:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788263180.060770:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788263180.060773:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788263180.060779:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788263180.060781:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788263180.060783:0:5846:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788263180.060796:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788263180.060798:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788263180.060831:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788263180.060834:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788263180.062360:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788263180.062453:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788263180.062491:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788263180.062841:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788263180.062951:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788263180.063091:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788263180.063107:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788263180.063109:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788263180.063765:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788263180.064376:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788263180.064428:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788263180.064484:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788263180.064498:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788263180.064500:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788263180.065109:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788263180.067522:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788263180.067657:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788263180.068592:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788263180.068636:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788263180.068707:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788263180.068722:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788263180.068725:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788263180.069719:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788263180.069782:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788263180.069838:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788263180.070635:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788263180.070680:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788263180.070718:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:3.0:1788263180.070739:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788263180.070760:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.070778:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994340031200/0x1a657bc513955938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955931 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.070786:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395595b expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.070794:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955985 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.070810:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139559a1 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.070816:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139559d9 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.070824:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.070866:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139559d9 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.070881:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139559d9 expref: 16 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263180.071047:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679104:0@lo:104: 00000100:00100000:3.0:1788263180.071622:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263180.071721:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139559a1 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.071734:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139559a1 expref: 16 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263180.071744:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679232:0@lo:104: 00010000:00010000:3.0:1788263180.071775:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955985 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.071783:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955985 expref: 16 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263180.071810:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679360:0@lo:104: 00010000:00010000:3.0:1788263180.071839:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc51395595b expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.071847:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc51395595b expref: 16 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263180.071855:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473de300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679488:0@lo:104: 00010000:00010000:3.0:1788263180.071878:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994340031200/0x1a657bc513955938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955931 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.071885:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994340031200/0x1a657bc513955938 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955931 expref: 16 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263180.071908:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679616:0@lo:104: 00000100:00100000:3.0:1788263180.071927:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372216f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263180.072487:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788263180.072514:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.072546:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.072556:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.072565:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.072576:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753679104 00000100:00100000:0.0:1788263180.072585:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753679104 00000100:00100000:0.0:1788263180.072619:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753679232 00000100:00100000:0.0:1788263180.072621:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753679232 00000100:00100000:0.0:1788263180.072630:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753679360 00000100:00100000:0.0:1788263180.072641:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753679360 00000100:00100000:0.0:1788263180.072655:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753679488 00000100:00100000:0.0:1788263180.072658:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753679488 00000100:00100000:0.0:1788263180.072666:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753679616 00000100:00100000:0.0:1788263180.072668:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753679616 00000100:00100000:0.0:1788263180.072681:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263180.072689:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+7:5846:x1875129753679104:12345-0@lo:104: 00010000:00010000:0.0:1788263180.072703:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.072764:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263180.072770:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f2e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+7:5846:x1875129753679104:12345-0@lo:104: Request processed in 82us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.072776:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263180.072816:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263180.072821:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+6:5846:x1875129753679232:12345-0@lo:104: 00010000:00010000:0.0:1788263180.072828:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.072862:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788263180.072867:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+6:5846:x1875129753679232:12345-0@lo:104: Request processed in 46us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.072872:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263180.072897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263180.072904:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:5846:x1875129753679360:12345-0@lo:104: 00010000:00010000:0.0:1788263180.072911:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.072939:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788263180.072951:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:5846:x1875129753679360:12345-0@lo:104: Request processed in 48us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.072957:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263180.072981:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263180.072988:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:5846:x1875129753679488:12345-0@lo:104: 00010000:00010000:0.0:1788263180.072994:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073020:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788263180.073024:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:5846:x1875129753679488:12345-0@lo:104: Request processed in 38us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.073029:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263180.073039:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263180.073045:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5846:x1875129753679616:12345-0@lo:104: 00010000:00010000:0.0:1788263180.073051:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9943821f4400/0x1a657bc513955931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073074:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788263180.073079:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5846:x1875129753679616:12345-0@lo:104: Request processed in 35us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.073084:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788263180.073103:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788263180.073110:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073117:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f5000 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263180.073121:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073157:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263180.073165:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263180.073172:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263180.073206:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073212:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263180.073261:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073269:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943821f5000/0x1a657bc5139559d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139559e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073283:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788263180.073286:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073291:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f5c00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263180.073294:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073299:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263180.073305:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263180.073316:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263180.073330:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073335:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263180.073341:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073347:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc5139559a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139559a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073355:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788263180.073357:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073362:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031000 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263180.073365:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073370:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263180.073375:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263180.073380:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263180.073390:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073394:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263180.073414:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073419:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc513955985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc51395598c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073428:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263180.073431:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073436:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158e00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263180.073439:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073445:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263180.073451:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263180.073457:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263180.073468:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073473:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263180.073478:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073483:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc51395595b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955962 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073490:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263180.073498:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943821f4400/0x1a657bc513955931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073504:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f4400 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263180.073506:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943821f4400/0x1a657bc513955931 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073512:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943821f4400/0x1a657bc513955931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263180.073517:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943821f4400/0x1a657bc513955931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263180.073520:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263180.073532:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9943821f4400/0x1a657bc513955931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073536:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263180.073539:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943821f4400/0x1a657bc513955931 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073544:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943821f4400/0x1a657bc513955931 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955938 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.073556:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263180.073558:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263180.073559:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263180.073581:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753679872:0@lo:103: 00000100:00100000:0.0:1788263180.073620:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.073657:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788263180.073663:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753679744:0@lo:103: 00000100:00100000:0.0:1788263180.073692:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.073709:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753680256:0@lo:103: 00000100:00100000:0.0:1788263180.073726:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.073747:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753680128:0@lo:103: 00000100:00100000:0.0:1788263180.073781:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.073796:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263180.073801:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753680000:0@lo:103: 00000100:00100000:0.0:1788263180.073821:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.073840:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753679872 00000100:00100000:0.0:1788263180.073846:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753679872 00010000:00010000:0.0:1788263180.073867:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139559a1 expref: 17 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.073882:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753679744 00000100:00100000:0.0:1788263180.073884:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753679744 00010000:00010000:0.0:1788263180.073895:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139559d9 expref: 18 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.073905:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753680256 00000100:00100000:0.0:1788263180.073907:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753680256 00010000:00010000:0.0:1788263180.073915:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994340031200/0x1a657bc513955938 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955931 expref: 19 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.073924:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753680128 00000100:00100000:0.0:1788263180.073926:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753680128 00010000:00010000:0.0:1788263180.073934:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395595b expref: 20 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.073944:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753680000 00000100:00100000:0.0:1788263180.073947:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753680000 00010000:00010000:0.0:1788263180.073967:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955985 expref: 21 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.073978:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263180.073984:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+21:3321:x1875129753679872:12345-0@lo:103: 00010000:00010000:0.0:1788263180.073993:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263180.073998:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139559a1 expref: 21 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074006:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139559a1 expref: 21 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074021:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263180.074049:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+21:3321:x1875129753679872:12345-0@lo:103: Request processed in 65us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.074058:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263180.074070:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263180.074076:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+20:3321:x1875129753679744:12345-0@lo:103: 00010000:00010000:0.0:1788263180.074082:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263180.074086:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139559d9 expref: 20 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074095:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139559d9 expref: 20 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074103:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263180.074123:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+20:3321:x1875129753679744:12345-0@lo:103: Request processed in 48us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.074128:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263180.074150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263180.074155:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753680256:12345-0@lo:103: 00010000:00010000:0.0:1788263180.074162:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263180.074166:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994340031200/0x1a657bc513955938 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955931 expref: 19 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074174:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994340031200/0x1a657bc513955938 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955931 expref: 19 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074183:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263180.074206:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753680256:12345-0@lo:103: Request processed in 50us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.074211:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263180.074258:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263180.074265:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:3323:x1875129753680128:12345-0@lo:103: 00010000:00010000:0.0:1788263180.074272:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263180.074276:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395595b expref: 18 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074284:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc51395595b expref: 18 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074293:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263180.074320:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:3323:x1875129753680128:12345-0@lo:103: Request processed in 56us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.074325:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263180.074337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263180.074343:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3323:x1875129753680000:12345-0@lo:103: 00010000:00010000:0.0:1788263180.074356:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263180.074366:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955985 expref: 17 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074375:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955985 expref: 17 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074387:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074395:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074408:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.074411:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263180.074418:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074425:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074432:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074438:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f4000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263180.074441:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074452:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074462:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.074483:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263180.074508:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340030e00/0x1a657bc5139559e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139559d9 expref: 17 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.074512:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3323:x1875129753680000:12345-0@lo:103: Request processed in 167us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.074523:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263180.074545:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679104:0@lo:104: 00000100:00100000:0.0:1788263180.074561:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753680000:0@lo:103: 00010000:00010000:3.0:1788263180.074564:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216d000/0x1a657bc5139559a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139559a1 expref: 15 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263180.074576:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679232:0@lo:104: 00000100:00100000:0.0:1788263180.074578:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753680128:0@lo:103: 00010000:00010000:3.0:1788263180.074596:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340030800/0x1a657bc51395598c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955985 expref: 14 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.074614:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753679744:0@lo:103: 00000100:00100000:3.0:1788263180.074619:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679360:0@lo:104: 00000100:00100000:0.0:1788263180.074626:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753680256:0@lo:103: 00010000:00010000:3.0:1788263180.074640:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340030c00/0x1a657bc513955962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc51395595b expref: 13 pid: 5847 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.074641:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753679872:0@lo:103: 00000100:00100000:3.0:1788263180.074657:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473de300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679488:0@lo:104: 00010000:00010000:3.0:1788263180.074670:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031200/0x1a657bc513955938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955931 expref: 12 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263180.074677:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5846:1875129753679616:0@lo:104: 00010000:00010000:3.0:1788263180.074698:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.074707:0:5846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.074714:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.074720:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f4000/0x1a657bc5139559f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788263180.074732:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788263180.132075:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:7644:x1875129753678976:12345-0@lo:253: Request processed in 76522us (77180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263180.132090:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263180.132208:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753678976:0@lo:253: 10000000:01000000:0.0:1788263180.132257:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788263180.132261:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263180.132263:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788263180.132264:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263180.132266:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788263180.132267:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263180.132268:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263180.132270:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263180.132271:0:7644:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788263180.132273:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263180.132275:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788263180.132296:0:7644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994375782000 from lustre-OST0001 10000000:01000000:0.0:1788263180.132325:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788263180.132327:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788263180.132336:0:7644:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9943473c3370 local copy 10000000:01000000:0.0:1788263180.132341:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788263180.132377:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.132398:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.132408:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.132428:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753680384:0@lo:101: 00000100:00100000:0.0:1788263180.132465:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.132520:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.132603:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753680384 00000100:00100000:2.0:1788263180.132609:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753680384 00000100:00100000:2.0:1788263180.132648:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788263180.132659:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:7644:x1875129753680384:12345-0@lo:101: 00010000:00010000:2.0:1788263180.132671:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263180.132685:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216de00/0x1a657bc513955a03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139559fc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.132707:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216de00/0x1a657bc513955a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139559fc expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.132717:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216de00/0x1a657bc513955a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139559fc expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.132726:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216de00, rc 0) 00000100:00100000:2.0:1788263180.132754:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753680384:12345-0@lo:101: Request processed in 96us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.132760:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263180.132869:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753680384:0@lo:101: 00010000:00010000:0.0:1788263180.132882:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.132890:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.132984:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753680512:0@lo:501: 00000100:00100000:0.0:1788263180.133009:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.133071:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce780 going to sleep for 11 seconds 00000100:00100000:3.0:1788263180.133187:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753680512 00000100:00100000:3.0:1788263180.133191:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753680512 00000100:00100000:3.0:1788263180.133295:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788263180.133309:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753680512:12345-0@lo:501: 00000100:00100000:3.0:1788263180.133519:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753680512:12345-0@lo:501: Request processed in 210us (509us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788263180.133524:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788263180.133577:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753680512:0@lo:501: 10000000:01000000:0.0:1788263180.133588:0:7644:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788263180.133607:0:7644:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788263180.133612:0:7644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.133618:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.133630:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.133648:0:7644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788263180.133674:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994375782000 10000000:01000000:0.0:1788263180.133679:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788263180.133684:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788263180.133687:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788263180.133691:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788263180.133693:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788263180.133707:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.133712:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.133718:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.133730:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753680640:0@lo:101: 00000100:00100000:0.0:1788263180.133755:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.133945:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbced80 going to sleep for 11 seconds 00010000:00010000:0.0:1788263180.133960:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263180.133966:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.133972:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031000 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263180.133976:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.133990:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263180.133997:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263180.134002:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263180.134020:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.134026:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263180.134042:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.134048:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994340031000/0x1a657bc5139559fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1a657bc513955a03 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.134061:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263180.134063:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263180.134064:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263180.134075:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753680768:0@lo:103: 00000100:00100000:0.0:1788263180.134104:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.134146:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753680768 00000100:00100000:0.0:1788263180.134150:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753680768 00000100:00100000:0.0:1788263180.134183:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263180.134189:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:3321:x1875129753680768:12345-0@lo:103: 00010000:00010000:0.0:1788263180.134199:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263180.134213:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216de00/0x1a657bc513955a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc5139559fc expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.134265:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263180.134296:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:3321:x1875129753680768:12345-0@lo:103: Request processed in 107us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.134303:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263180.134331:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753680768:0@lo:103: 00000100:00100000:2.0:1788263180.134506:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753680640 00000100:00100000:2.0:1788263180.134510:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753680640 00000100:00100000:2.0:1788263180.134530:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788263180.134535:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+11:7644:x1875129753680640:12345-0@lo:101: 00010000:00010000:2.0:1788263180.134543:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263180.134553:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955a0a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.134569:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955a0a expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.134589:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a0a expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.134596:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216cc00, rc 0) 00000100:00100000:2.0:1788263180.134634:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753680640:12345-0@lo:101: Request processed in 99us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.134640:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788263180.134699:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753680640:0@lo:101: 00010000:00010000:0.0:1788263180.134710:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.134719:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.134791:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753680896:0@lo:501: 00000100:00100000:0.0:1788263180.134815:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.134843:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbced80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.134888:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753680896 00000100:00100000:2.0:1788263180.134892:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753680896 00000100:00100000:2.0:1788263180.134910:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788263180.134915:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753680896:12345-0@lo:501: 00000100:00100000:2.0:1788263180.135111:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753680896:12345-0@lo:501: Request processed in 194us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.135118:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788263180.135271:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753680896:0@lo:501: 00000100:00100000:0.0:1788263180.135296:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681024:0@lo:503: 00000100:00100000:0.0:1788263180.135334:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.135350:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbced80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.135419:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753681024 00000100:00100000:2.0:1788263180.135424:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753681024 00000100:00100000:2.0:1788263180.135441:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788263180.135446:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753681024:12345-0@lo:503: 00000100:00100000:2.0:1788263180.135582:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753681024:12345-0@lo:503: Request processed in 135us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.135589:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788263180.135628:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681024:0@lo:503: 00000040:00080000:2.0:1788263180.135869:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263180.135926:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681152:0@lo:502: 00000100:00100000:2.0:1788263180.135960:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.135986:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9eec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.136000:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753681152 00000100:00100000:2.0:1788263180.136003:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753681152 00000100:00100000:2.0:1788263180.136020:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788263180.136026:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753681152:12345-0@lo:502: 00000100:00100000:2.0:1788263180.136378:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753681152:12345-0@lo:502: Request processed in 351us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.136385:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788263180.136519:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681152:0@lo:502: 00000040:00080000:0.0:1788263180.136766:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788263180.136813:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788263180.136840:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788263180.136898:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788263180.136939:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788263180.136981:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788263180.137009:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681280:0@lo:502: 00000100:00100000:0.0:1788263180.137047:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.137079:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbcec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.137137:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753681280 00000100:00100000:2.0:1788263180.137143:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753681280 00000100:00100000:2.0:1788263180.137178:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788263180.137185:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753681280:12345-0@lo:502: 00000100:00100000:2.0:1788263180.137366:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753681280:12345-0@lo:502: Request processed in 181us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.137373:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788263180.137588:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681280:0@lo:502: 00000040:00080000:0.0:1788263180.137677:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788263180.137688:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788263180.138548:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788263180.138558:0:7651:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788263180.138565:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263180.138567:0:7651:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788263180.138572:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788263180.138589:0:7651:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99434643cd28) 00000020:00000080:3.0:1788263180.138612:0:7651:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788263180.138619:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788263180.138680:0:7651:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994375782000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788263180.138688:0:7651:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788263180.138696:0:7651:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1a657bc513955a1f 00010000:00010000:3.0:1788263180.145753:0:7651:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788263180.146045:0:7651:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788263180.149033:0:7651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788263180.149590:0:7651:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788263180.157761:0:7651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788263180.162009:0:7651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788263180.163417:0:7651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788263180.163430:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263180.163437:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263180.163439:0:7651:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788263180.163442:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263180.163447:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263180.163449:0:7651:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788263180.163452:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788263180.163454:0:7651:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788263180.163500:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263180.163510:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263180.163512:0:7651:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788263180.163516:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788263180.168326:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788263180.168370:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788263180.169804:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.169820:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263180.169829:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994375782000 from 1 10000000:01000000:1.0:1788263180.169832:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263180.169880:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.169888:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.169899:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263180.169923:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681408:0@lo:101: 00000100:00100000:1.0:1788263180.169997:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263180.170035:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.170139:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753681408 00000100:00100000:2.0:1788263180.170148:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753681408 00000100:00100000:2.0:1788263180.170254:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788263180.170264:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:7644:x1875129753681408:12345-0@lo:101: 00010000:00010000:2.0:1788263180.170278:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263180.170291:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955a26 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.170313:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955a26 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.170322:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a26 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.170341:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216c000, rc 0) 00000100:00100000:2.0:1788263180.170381:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753681408:12345-0@lo:101: Request processed in 118us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.170388:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788263180.170447:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681408:0@lo:101: 00010000:00010000:2.0:1788263180.170462:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.170470:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263180.170565:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681536:0@lo:501: 00000100:00100000:2.0:1788263180.170591:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.170608:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.170622:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753681536 00000100:00100000:2.0:1788263180.170627:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753681536 00000100:00100000:2.0:1788263180.170648:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788263180.170654:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753681536:12345-0@lo:501: 00000100:00100000:2.0:1788263180.170861:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753681536:12345-0@lo:501: Request processed in 206us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.170868:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788263180.170900:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681536:0@lo:501: 00000100:00100000:2.0:1788263180.170926:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681664:0@lo:503: 00000100:00100000:2.0:1788263180.170961:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.170972:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.170989:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753681664 00000100:00100000:2.0:1788263180.170993:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753681664 00000100:00100000:2.0:1788263180.171008:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788263180.171013:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753681664:12345-0@lo:503: 00000100:00100000:2.0:1788263180.171325:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753681664:12345-0@lo:503: Request processed in 311us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.171331:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788263180.171372:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681664:0@lo:503: 00000040:00080000:2.0:1788263180.171623:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263180.171681:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681792:0@lo:502: 00000100:00100000:2.0:1788263180.171720:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.171736:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.171752:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753681792 00000100:00100000:2.0:1788263180.171755:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753681792 00000100:00100000:2.0:1788263180.171773:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788263180.171779:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753681792:12345-0@lo:502: 00000100:00100000:2.0:1788263180.171924:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753681792:12345-0@lo:502: Request processed in 145us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.171932:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788263180.171971:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681792:0@lo:502: 00000040:00080000:2.0:1788263180.172276:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788263180.172325:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788263180.172351:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681920:0@lo:502: 00000100:00100000:2.0:1788263180.172384:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.172399:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.172413:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753681920 00000100:00100000:2.0:1788263180.172417:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753681920 00000100:00100000:2.0:1788263180.172443:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788263180.172449:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753681920:12345-0@lo:502: 00000100:00100000:2.0:1788263180.172568:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753681920:12345-0@lo:502: Request processed in 119us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.172574:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788263180.172616:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753681920:0@lo:502: 00000040:00080000:2.0:1788263180.172695:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788263180.172705:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788263180.174490:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263180.174501:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263180.174503:0:7655:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788263180.174510:0:7655:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994375782000 00000020:00000080:1.0:1788263180.174512:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788263180.174529:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263180.174532:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263180.174533:0:7655:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788263180.174535:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788263180.174676:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788263180.174707:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263180.174768:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.174781:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263180.174825:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788263180.174828:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994375782000 10000000:01000000:2.0:1788263180.174831:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994375782000 10000000:01000000:2.0:1788263180.174835:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263180.174841:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994375782000 from 1 10000000:01000000:2.0:1788263180.174843:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788263180.174878:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.174886:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.174896:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263180.174928:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682048:0@lo:101: 00000100:00100000:2.0:1788263180.174987:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.175031:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee240 going to sleep for 11 seconds 00000100:00100000:3.0:1788263180.175087:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753682048 00000100:00100000:3.0:1788263180.175095:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753682048 00000100:00100000:3.0:1788263180.175146:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788263180.175155:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753682048:12345-0@lo:101: 00010000:00010000:3.0:1788263180.175167:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263180.175179:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955a34 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.175200:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955a34 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.175210:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a34 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263180.175248:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943821f4000, rc 0) 00000100:00100000:3.0:1788263180.175295:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682048:12345-0@lo:101: Request processed in 140us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263180.175302:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788263180.175443:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682048:0@lo:101: 00010000:00010000:2.0:1788263180.175457:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.175465:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263180.175548:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682176:0@lo:501: 00000100:00100000:2.0:1788263180.175573:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.175603:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263180.175682:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753682176 00000100:00100000:1.0:1788263180.175687:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753682176 00000100:00100000:1.0:1788263180.175713:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788263180.175720:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682176:12345-0@lo:501: 00000100:00100000:1.0:1788263180.175943:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682176:12345-0@lo:501: Request processed in 222us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.175950:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788263180.176043:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682176:0@lo:501: 00000100:00100000:2.0:1788263180.176070:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682304:0@lo:503: 00000100:00100000:2.0:1788263180.176107:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.176135:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263180.176253:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753682304 00000100:00100000:1.0:1788263180.176258:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753682304 00000100:00100000:1.0:1788263180.176287:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788263180.176300:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682304:12345-0@lo:503: 00000100:00100000:1.0:1788263180.176437:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682304:12345-0@lo:503: Request processed in 138us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.176444:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788263180.176523:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682304:0@lo:503: 00000040:00080000:2.0:1788263180.176799:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263180.176854:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682432:0@lo:502: 00000100:00100000:2.0:1788263180.176893:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.176925:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263180.176979:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753682432 00000100:00100000:1.0:1788263180.176983:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753682432 00000100:00100000:1.0:1788263180.177018:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788263180.177025:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682432:12345-0@lo:502: 00000100:00100000:1.0:1788263180.177191:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682432:12345-0@lo:502: Request processed in 165us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.177198:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788263180.177468:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682432:0@lo:502: 00000040:00080000:2.0:1788263180.177746:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788263180.177805:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788263180.177839:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788263180.177884:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788263180.177919:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788263180.177961:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788263180.177994:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788263180.178024:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788263180.178068:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788263180.178103:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788263180.178256:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788263180.178315:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788263180.178367:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788263180.178403:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788263180.178453:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788263180.178489:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788263180.178524:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788263180.178584:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788263180.178622:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788263180.178656:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788263180.178703:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788263180.178742:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788263180.178780:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788263180.178826:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788263180.178867:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788263180.178902:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788263180.178951:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788263180.178988:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788263180.179031:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788263180.179093:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788263180.180445:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788263180.180517:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788263180.180555:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788263180.180616:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788263180.180653:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788263180.180705:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788263180.180744:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788263180.180797:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682560:0@lo:502: 00000100:00100000:3.0:1788263180.180884:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263180.180940:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372216a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263180.181002:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753682560 00000100:00100000:1.0:1788263180.181009:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753682560 00000100:00100000:1.0:1788263180.181063:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788263180.181073:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682560:12345-0@lo:502: 00000100:00100000:1.0:1788263180.181350:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682560:12345-0@lo:502: Request processed in 278us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.181358:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788263180.181536:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682560:0@lo:502: 00000040:00080000:2.0:1788263180.181613:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788263180.181623:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788263180.182886:0:7656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788263180.182909:0:7656:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9942421b19b8) 00000020:00000080:3.0:1788263180.182936:0:7656:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788263180.183015:0:7656:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994375782000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788263180.183019:0:7656:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994375782000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788263180.183022:0:7656:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994375782000 3 00010000:00080000:3.0:1788263180.183054:0:7656:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9942421a9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1788263180.184963:0:7656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788263180.185485:0:7656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788263180.185524:0:7656:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788263180.185541:0:7656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1a657bc513955a49 00000100:00080000:3.0:1788263180.185552:0:7656:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263180.185557:0:7656:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9942421a9000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263180.185600:0:7656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9943473de300 x1875129753682688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263180.185665:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753682688:0@lo:38: 00000100:00100000:2.0:1788263180.185744:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788263180.185839:0:7656:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788263180.189466:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753682688 00000100:00100000:1.0:1788263180.189482:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753682688 00000100:00100000:1.0:1788263180.189531:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263180.189540:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1875129753682688:12345-0@lo:38: 00010000:00080000:1.0:1788263180.189572:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:1.0:1788263180.190103:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1a657bc513955a50 00000004:00100000:1.0:1788263180.190132:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788263180.190170:0:5853:0:(import.c:65:import_set_state_nolock()) ffff99437f579800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263180.190294:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875129753682688:12345-0@lo:38: Request processed in 752us (4547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.190309:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1788263180.190806:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1788263180.190977:0:7658:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9943473dd880 x1875129753682816/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263180.190989:0:7658:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372216900 going to sleep for 0 seconds 00010000:00080000:2.0:1788263180.191086:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9943473de300 x1875129753682688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263180.191099:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263180.191108:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788263180.191115:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788263180.191186:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788263180.191190:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9942421a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788263180.191198:0:3319:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ec90c1a0): req@ffff9943473dd880 x1875129753682816/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:1.0:1788263180.192271:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788263180.192309:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263180.192332:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.192344:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788263180.192392:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788263180.192394:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788263180.192395:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263180.192396:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263180.192398:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263180.192399:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263180.192400:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263180.192402:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788263180.192404:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788263180.192405:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263180.192407:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263180.192411:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788263180.192414:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788263180.192415:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788263180.192416:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263180.192418:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263180.192419:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263180.192420:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263180.192421:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263180.192422:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788263180.192423:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788263180.192424:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263180.192425:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263180.192445:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788263180.192459:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682944:0@lo:253: 00000100:00100000:1.0:1788263180.192534:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263180.192569:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330540 going to sleep for 11 seconds 00000100:00100000:3.0:1788263180.192673:0:7658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263180.192700:0:7658:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372216900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263180.192752:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753682816 00000100:00100000:1.0:1788263180.192759:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753682816 00000100:00100000:1.0:1788263180.192822:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263180.192832:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1875129753682816:12345-0@lo:901: 00000100:00100000:1.0:1788263180.193258:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7658:x1875129753682816:12345-0@lo:901: Request processed in 427us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.193266:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788263180.193406:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788263180.193435:0:7658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9943473dd880 x1875129753682816/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788263196 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263180.193449:0:7658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7658:1875129753682816:0@lo:901: 00000100:00100000:3.0:1788263180.194357:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753682944 00000100:00100000:3.0:1788263180.194367:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753682944 00000100:00100000:3.0:1788263180.194426:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788263180.194435:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:7644:x1875129753682944:12345-0@lo:253: 20000000:01000000:3.0:1788263180.194458:0:5847:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788263180.194471:0:5847:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788263180.195650:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753682688:0@lo:38: 20000000:01000000:3.0:1788263180.218461:0:5847:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788263180.218481:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788263180.218586:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788263180.218592:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788263180.218614:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.218633:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955993 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.218642:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.218684:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955993 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263180.218697:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955993 expref: 14 pid: 5846 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263180.218710:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875129753683072:0@lo:104: 00000100:00100000:0.0:1788263180.218774:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.218819:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263180.218915:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753683072 00000100:00100000:2.0:1788263180.218924:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753683072 00000100:00100000:2.0:1788263180.218975:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263180.218985:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5868:x1875129753683072:12345-0@lo:104: 00010000:00010000:2.0:1788263180.218997:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263180.219051:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263180.219060:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:5868:x1875129753683072:12345-0@lo:104: Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263180.219067:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263180.219107:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1875129753683072:0@lo:104: 00010000:00010000:2.0:1788263180.219135:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219405:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263180.219412:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219419:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263180.219423:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219431:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263180.219438:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263180.219445:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263180.219510:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219517:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263180.219544:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219561:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216ca00/0x1a657bc513955993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc51395599a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219576:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263180.219578:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263180.219580:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263180.219587:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263180.219599:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753683200:0@lo:103: 00000100:00100000:1.0:1788263180.219641:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263180.219675:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753683200 00000100:00100000:1.0:1788263180.219679:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753683200 00010000:00010000:1.0:1788263180.219700:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955993 expref: 15 pid: 5846 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263180.219721:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263180.219727:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:3323:x1875129753683200:12345-0@lo:103: 00010000:00010000:1.0:1788263180.219738:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263180.219742:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955993 expref: 15 pid: 5846 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219752:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955993 expref: 15 pid: 5846 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219763:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031e00/0x1a657bc51395599a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955993 expref: 15 pid: 5846 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219774:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219791:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788263180.219803:0:5837:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002817165s 00010000:00010000:1.0:1788263180.219807:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219813:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219819:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219824:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219829:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263180.219833:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219839:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219852:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219861:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263180.219891:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc90c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:3323:x1875129753683200:12345-0@lo:103: Request processed in 164us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.219899:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263180.219958:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753683200:0@lo:103: 00010000:00010000:1.0:1788263180.219975:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219981:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263180.219987:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031000/0x1a657bc513955a57 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263180.231821:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:7644:x1875129753682944:12345-0@lo:253: Request processed in 37378us (39278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263180.231837:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788263180.231925:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33366ce6-2c46-49eb-9afc-8617712bc2f4:7644:1875129753682944:0@lo:253: 10000000:01000000:1.0:1788263180.231943:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788263180.231947:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788263180.231948:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788263180.231950:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263180.231951:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263180.231953:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263180.231953:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263180.231955:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263180.231956:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788263180.231958:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788263180.231960:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263180.231961:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788263180.231977:0:7644:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788263180.237559:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263180.237764:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788263180.237962:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263180.238451:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788263180.238660:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263180.238913:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788263180.240058:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788263180.458420:0:7644:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788263180.458430:0:7644:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788263180.458480:0:7644:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788263180.458538:0:7644:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788263180.458553:0:7644:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788263180.458581:0:7644:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788263180.482410:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263181.499484:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263182.527251:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263183.549144:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263184.572070:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263185.149483:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753683328:0@lo:13: 00000100:00100000:0.0:1788263185.149566:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.149653:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753683328 00000100:00100000:0.0:1788263185.149662:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753683328 00000100:00100000:0.0:1788263185.149714:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263185.149725:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753683328:12345-0@lo:13: 00002000:00000024:0.0:1788263185.149761:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263185.149805:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753683328:12345-0@lo:13: Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.149813:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788263185.149833:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788263185.149859:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99438118b100 x1875129753683328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263185.149878:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753683328:0@lo:13: 00010000:00010000:0.0:1788263185.598109:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263185.663102:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753683712:0@lo:400: 00000100:00100000:2.0:1788263185.663195:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.663274:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263185.663281:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753683840:0@lo:400: 00000100:00100000:2.0:1788263185.663310:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.663350:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753683712 00000100:00100000:2.0:1788263185.663358:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753683712 00000100:00100000:2.0:1788263185.663414:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263185.663425:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753683712:12345-0@lo:400: 00000100:00100000:2.0:1788263185.663476:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753683712:12345-0@lo:400: Request processed in 53us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.663484:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263185.663521:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753683840 00000100:00100000:2.0:1788263185.663525:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753683840 00000100:00100000:2.0:1788263185.663552:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263185.663559:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753683840:12345-0@lo:400: 00000100:00100000:2.0:1788263185.663590:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753683840:12345-0@lo:400: Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.663803:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788263185.663823:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788263185.663859:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943473dd180 x1875129753683840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263185.663874:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753683840:0@lo:400: 00010000:00080000:2.0:1788263185.663886:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943473dce00 x1875129753683712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263185.663925:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753683712:0@lo:400: 00000100:00100000:3.0:1788263185.664246:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753683584:0@lo:400: 00000100:00100000:3.0:1788263185.664287:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.664312:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788263185.664319:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753683456:0@lo:400: 00000100:00100000:3.0:1788263185.664349:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.664375:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753683968:0@lo:400: 00000100:00100000:3.0:1788263185.664396:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.664431:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753683456 00000100:00100000:3.0:1788263185.664435:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753683456 00000100:00100000:3.0:1788263185.664470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788263185.664478:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:3321:x1875129753683456:12345-0@lo:400: 00000100:00100000:3.0:1788263185.664530:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:3321:x1875129753683456:12345-0@lo:400: Request processed in 53us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.664537:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788263185.665183:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753683456:0@lo:400: 00000100:00100000:2.0:1788263185.666615:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753683584 00000100:00100000:2.0:1788263185.666627:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753683584 00000100:00100000:2.0:1788263185.666668:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753683968 00000100:00100000:2.0:1788263185.666671:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753683968 00000100:00100000:2.0:1788263185.666705:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263185.666714:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753683584:12345-0@lo:400: 00000100:00100000:2.0:1788263185.666798:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753683584:12345-0@lo:400: Request processed in 85us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.666805:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263185.666821:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263185.666827:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753683968:12345-0@lo:400: 00000100:00100000:2.0:1788263185.666854:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753683968:12345-0@lo:400: Request processed in 27us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.666860:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788263185.666879:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788263185.667041:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943473de680 x1875129753683968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263185.667055:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753683968:0@lo:400: 00010000:00080000:2.0:1788263185.667145:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943473df800 x1875129753683584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263185.667155:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753683584:0@lo:400: 00010000:00010000:2.0:1788263186.619342:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788263187.066899:0:8002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788263187.646179:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263188.669049:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788263189.243816:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788263189.243825:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99438144e800 from 30 10000000:01000000:0.0:1788263189.243917:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263189.244794:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263189.244812:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263189.244826:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263189.244924:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684096:0@lo:101: 00000100:00100000:0.0:1788263189.246816:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.247859:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263189.248524:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753684096 00000100:00100000:3.0:1788263189.248535:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753684096 00000100:00100000:3.0:1788263189.248609:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788263189.248646:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753684096:12345-0@lo:101: 00010000:00010000:3.0:1788263189.248662:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263189.248680:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955a5e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263189.248709:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955a5e expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263189.248720:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a5e expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263189.248728:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943821f5600, rc 0) 00000100:00100000:3.0:1788263189.248801:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753684096:12345-0@lo:101: Request processed in 171us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263189.248809:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788263189.249025:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684096:0@lo:101: 00010000:00010000:1.0:1788263189.249042:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.249052:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263189.249143:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684224:0@lo:501: 00000100:00100000:1.0:1788263189.249176:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.249354:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753684224 00000100:00100000:0.0:1788263189.249358:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753684224 00000100:00100000:0.0:1788263189.249388:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788263189.249395:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753684224:12345-0@lo:501: 00000100:00100000:0.0:1788263189.249784:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753684224:12345-0@lo:501: Request processed in 388us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263189.249791:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788263189.256094:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce780 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.256142:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684224:0@lo:501: 00000100:00100000:1.0:1788263189.256208:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684352:0@lo:503: 00000100:00100000:1.0:1788263189.256305:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.256415:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263189.261485:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753684352 00000100:00100000:0.0:1788263189.261500:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753684352 00000100:00100000:0.0:1788263189.261575:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788263189.261595:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753684352:12345-0@lo:503: 00000100:00100000:0.0:1788263189.262214:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753684352:12345-0@lo:503: Request processed in 628us (5908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263189.262238:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788263189.265459:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684352:0@lo:503: 00000100:00100000:1.0:1788263189.266193:0:8106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8106:1875129753684480:0@lo:502: 00000100:00100000:1.0:1788263189.266294:0:8106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.266344:0:8106:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce300 going to sleep for 11 seconds 00000100:00100000:2.0:1788263189.266501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753684480 00000100:00100000:2.0:1788263189.266514:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753684480 00000100:00100000:2.0:1788263189.266571:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788263189.266582:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:8106:x1875129753684480:12345-0@lo:502: 00000100:00100000:2.0:1788263189.267457:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:8106:x1875129753684480:12345-0@lo:502: Request processed in 874us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.267467:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788263189.267659:0:8106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8106:1875129753684480:0@lo:502: 00000100:00100000:1.0:1788263189.267718:0:8106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8106:1875129753684608:0@lo:502: 00000100:00100000:1.0:1788263189.267757:0:8106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.267779:0:8106:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263189.268059:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753684608 00000100:00100000:0.0:1788263189.268075:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753684608 00000100:00100000:0.0:1788263189.268121:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788263189.268128:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:8106:x1875129753684608:12345-0@lo:502: 00000100:00100000:0.0:1788263189.268323:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:8106:x1875129753684608:12345-0@lo:502: Request processed in 195us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263189.268330:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788263189.268405:0:8106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8106:1875129753684608:0@lo:502: 00000040:00080000:1.0:1788263189.268423:0:8106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788263189.268566:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788263189.268586:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788263189.268604:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263189.269074:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263189.269086:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788263189.269089:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788263189.269092:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788263189.269122:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263189.269129:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263189.269138:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263189.269151:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684736:0@lo:101: 00000100:00100000:0.0:1788263189.269184:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263189.269313:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753684736 00000100:00100000:2.0:1788263189.269319:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753684736 00000100:00100000:2.0:1788263189.269352:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788263189.269359:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753684736:12345-0@lo:101: 00010000:00010000:2.0:1788263189.269370:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788263189.269375:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454db180 going to sleep for 11 seconds 00010000:00010000:2.0:1788263189.269382:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955a6c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263189.269404:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955a6c expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263189.269414:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a6c expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263189.269423:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d000, rc 0) 00000100:00100000:2.0:1788263189.269469:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753684736:12345-0@lo:101: Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263189.269517:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684736:0@lo:101: 00010000:00010000:0.0:1788263189.269540:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263189.269549:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263189.269600:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684864:0@lo:501: 00000100:00100000:0.0:1788263189.269623:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.269735:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454db180 going to sleep for 11 seconds 00000100:00100000:3.0:1788263189.278039:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753684864 00000100:00100000:3.0:1788263189.278054:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753684864 00000100:00100000:2.0:1788263189.279075:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788263189.279576:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788263189.279884:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753684864:12345-0@lo:501: 00000100:00100000:3.0:1788263189.280500:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753684864:12345-0@lo:501: Request processed in 912us (10873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263189.280510:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788263189.280629:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684864:0@lo:501: 00000100:00100000:0.0:1788263189.280816:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684992:0@lo:503: 00000100:00100000:0.0:1788263189.281759:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.281795:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454db180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263189.281877:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753684992 00000100:00100000:2.0:1788263189.281886:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753684992 00000100:00100000:2.0:1788263189.281943:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788263189.281953:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753684992:12345-0@lo:503: 00000100:00100000:2.0:1788263189.282269:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753684992:12345-0@lo:503: Request processed in 317us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.282283:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788263189.282456:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753684992:0@lo:503: 00000100:00100000:0.0:1788263189.282731:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8107:1875129753685120:0@lo:502: 00000100:00100000:0.0:1788263189.282771:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.282786:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454dbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263189.282948:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753685120 00000100:00100000:2.0:1788263189.282954:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753685120 00000100:00100000:2.0:1788263189.283018:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788263189.283026:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:8107:x1875129753685120:12345-0@lo:502: 00000100:00100000:2.0:1788263189.283204:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:8107:x1875129753685120:12345-0@lo:502: Request processed in 179us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.283211:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788263189.283294:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8107:1875129753685120:0@lo:502: 00000020:01000000:0.0:1788263189.283319:0:8107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263189.283328:0:8107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263189.283331:0:8107:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788263189.283337:0:8107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788263189.283339:0:8107:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788263189.283354:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8107:1875129753685248:0@lo:502: 00000100:00100000:0.0:1788263189.283387:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.288510:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffff994355abd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.288589:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753685248 00000100:00100000:1.0:1788263189.288600:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753685248 00000100:00100000:1.0:1788263189.288658:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788263189.288669:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:8107:x1875129753685248:12345-0@lo:502: 00000100:00100000:1.0:1788263189.288960:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:8107:x1875129753685248:12345-0@lo:502: Request processed in 291us (5570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.288987:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788263189.289101:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8107:1875129753685248:0@lo:502: 00000020:01000000:0.0:1788263189.289133:0:8107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263189.289141:0:8107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263189.289143:0:8107:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788263189.289147:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788263189.289449:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788263189.289467:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788263189.289477:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.289488:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263189.289498:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788263189.289501:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994350979800 from 30 10000000:01000000:1.0:1788263189.289504:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788263189.289535:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.289543:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.289552:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263189.289571:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753685376:0@lo:101: 00000100:00100000:1.0:1788263189.289609:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.289632:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.289645:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753685376 00000100:00100000:1.0:1788263189.289649:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753685376 00000100:00100000:1.0:1788263189.289671:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788263189.289677:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753685376:12345-0@lo:101: 00010000:00010000:1.0:1788263189.289686:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263189.289706:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955a7a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.289728:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955a7a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.289738:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a7a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.289747:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159200, rc 0) 00000100:00100000:1.0:1788263189.289777:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753685376:12345-0@lo:101: Request processed in 100us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.289783:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788263189.289814:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753685376:0@lo:101: 00010000:00010000:1.0:1788263189.289826:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.289835:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263189.289873:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753685504:0@lo:501: 00000100:00100000:1.0:1788263189.289898:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.289910:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.289920:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753685504 00000100:00100000:1.0:1788263189.289923:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753685504 00000100:00100000:1.0:1788263189.289957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788263189.289963:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753685504:12345-0@lo:501: 00000100:00100000:1.0:1788263189.290202:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753685504:12345-0@lo:501: Request processed in 238us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.290250:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788263189.290283:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753685504:0@lo:501: 00000100:00100000:1.0:1788263189.290312:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753685632:0@lo:503: 00000100:00100000:1.0:1788263189.290346:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.290365:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.290375:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753685632 00000100:00100000:1.0:1788263189.290379:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753685632 00000100:00100000:1.0:1788263189.290396:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788263189.290401:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753685632:12345-0@lo:503: 00000100:00100000:1.0:1788263189.290520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753685632:12345-0@lo:503: Request processed in 118us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.290525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788263189.290552:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753685632:0@lo:503: 00000100:00100000:1.0:1788263189.290702:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8108:1875129753685760:0@lo:502: 00000100:00100000:1.0:1788263189.290733:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.290750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753685760 00000100:00100000:1.0:1788263189.290753:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753685760 00000100:00100000:1.0:1788263189.290770:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788263189.290775:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:8108:x1875129753685760:12345-0@lo:502: 00000100:00100000:1.0:1788263189.290909:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:8108:x1875129753685760:12345-0@lo:502: Request processed in 132us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.290916:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788263189.290942:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.290957:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8108:1875129753685760:0@lo:502: 00000100:00100000:1.0:1788263189.290998:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8108:1875129753685888:0@lo:502: 00000100:00100000:1.0:1788263189.291025:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.291041:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753685888 00000100:00100000:1.0:1788263189.291044:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753685888 00000100:00100000:1.0:1788263189.291060:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788263189.291079:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:8108:x1875129753685888:12345-0@lo:502: 00000100:00100000:1.0:1788263189.291186:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:8108:x1875129753685888:12345-0@lo:502: Request processed in 107us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.291192:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788263189.291248:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.291259:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8108:1875129753685888:0@lo:502: 00000040:00080000:1.0:1788263189.291276:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788263189.291318:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788263189.291334:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263189.291342:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291353:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263189.291362:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788263189.291365:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994350979800 from 5 10000000:01000000:1.0:1788263189.291368:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788263189.291393:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291400:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291420:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263189.291431:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686016:0@lo:101: 00000100:00100000:1.0:1788263189.291456:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.291470:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.291480:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753686016 00000100:00100000:1.0:1788263189.291483:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753686016 00000100:00100000:1.0:1788263189.291499:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788263189.291504:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753686016:12345-0@lo:101: 00010000:00010000:1.0:1788263189.291510:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263189.291521:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343159400/0x1a657bc513955a8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955a88 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291537:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343159400/0x1a657bc513955a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955a88 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291545:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343159400/0x1a657bc513955a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a88 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291553:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159400, rc 0) 00000100:00100000:1.0:1788263189.291580:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753686016:12345-0@lo:101: Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.291586:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788263189.291612:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686016:0@lo:101: 00010000:00010000:1.0:1788263189.291623:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291640:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263189.291681:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686144:0@lo:256: 00000100:00100000:1.0:1788263189.291708:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.291719:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.291730:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753686144 00000100:00100000:1.0:1788263189.291733:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753686144 00000100:00100000:1.0:1788263189.291747:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788263189.291753:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753686144:12345-0@lo:256: 20000000:01000000:1.0:1788263189.291764:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263189.291782:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263189.291785:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788263189.291857:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753686144:12345-0@lo:256: Request processed in 103us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.291864:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788263189.291892:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686144:0@lo:256: 10000000:01000000:1.0:1788263189.291932:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788263189.291938:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291945:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263189.291952:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788263189.291954:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788263189.291957:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788263189.291975:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291981:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.291988:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263189.292000:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686272:0@lo:101: 00000100:00100000:1.0:1788263189.292022:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.292034:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.292044:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753686272 00000100:00100000:1.0:1788263189.292047:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753686272 00000100:00100000:1.0:1788263189.292074:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788263189.292081:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753686272:12345-0@lo:101: 00010000:00010000:1.0:1788263189.292087:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263189.292096:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955a96 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.292110:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955a96 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.292118:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a96 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.292124:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159000, rc 0) 00000100:00100000:1.0:1788263189.292150:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753686272:12345-0@lo:101: Request processed in 70us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.292155:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788263189.292189:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686272:0@lo:101: 00010000:00010000:1.0:1788263189.292199:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.292207:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263189.292271:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686400:0@lo:501: 00000100:00100000:1.0:1788263189.292294:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.292314:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.292324:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753686400 00000100:00100000:1.0:1788263189.292328:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753686400 00000100:00100000:1.0:1788263189.292343:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788263189.292349:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753686400:12345-0@lo:501: 00000100:00100000:1.0:1788263189.292567:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753686400:12345-0@lo:501: Request processed in 217us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.292574:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788263189.292600:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686400:0@lo:501: 00000100:00100000:1.0:1788263189.292622:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686528:0@lo:503: 00000100:00100000:1.0:1788263189.292657:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.292669:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943438e0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.292679:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753686528 00000100:00100000:1.0:1788263189.292682:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753686528 00000100:00100000:1.0:1788263189.292697:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788263189.292702:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753686528:12345-0@lo:503: 00000100:00100000:1.0:1788263189.292864:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753686528:12345-0@lo:503: Request processed in 161us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.292878:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788263189.292911:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753686528:0@lo:503: 00000100:00100000:0.0:1788263189.295340:0:8109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8109:1875129753686656:0@lo:502: 00000100:00100000:0.0:1788263189.295416:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.295491:0:8109:0:(client.c:2715:ptlrpc_set_wait()) set ffff994355abd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.295529:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753686656 00000100:00100000:1.0:1788263189.295538:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753686656 00000100:00100000:1.0:1788263189.295616:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788263189.295625:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8109:x1875129753686656:12345-0@lo:502: 00000100:00100000:1.0:1788263189.296037:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8109:x1875129753686656:12345-0@lo:502: Request processed in 413us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.296044:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788263189.296391:0:8109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8109:1875129753686656:0@lo:502: 00000020:01000000:0.0:1788263189.296423:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788263189.296432:0:8109:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788263189.296439:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263189.296441:0:8109:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788263189.296445:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788263189.296448:0:8109:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:0.0:1788263189.296471:0:8109:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788263189.296474:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263189.296501:0:8109:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99437f9c99b8) 00000020:00000080:0.0:1788263189.296523:0:8109:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788263189.296529:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788263189.296597:0:8109:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788263189.296602:0:8109:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788263189.296610:0:8109:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513955aab 00010000:00080000:0.0:1788263189.296765:0:8109:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994342fd2000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1788263189.297300:0:8109:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788263189.297619:0:8109:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788263189.297802:0:8109:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788263189.298448:0:8109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263189.298665:0:8109:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263189.298959:0:8109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788263189.299020:0:8109:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788263189.299765:0:8110:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263189.299771:0:8110:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788263189.300750:0:8109:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788263189.300764:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788263189.300797:0:8109:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788263189.300819:0:8109:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513955ab2 00000100:00080000:2.0:1788263189.300829:0:8109:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263189.300834:0:8109:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994342fd2000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788263189.300944:0:8109:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994380632d80 x1875129753686784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788263189.301053:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753686784:0@lo:8: 00000100:00100000:0.0:1788263189.301145:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263189.301175:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753686784 00000100:00100000:3.0:1788263189.301182:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753686784 00000100:00080000:2.0:1788263189.301205:0:8109:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788263189.301212:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263189.301240:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753686784:12345-0@lo:8: 00010000:00080000:3.0:1788263189.301262:0:6702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:01000000:2.0:1788263189.301267:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263189.301270:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263189.301272:0:8109:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788263189.301275:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263189.301278:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263189.301279:0:8109:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263189.301282:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263189.301283:0:8109:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:00000080:3.0:1788263189.301286:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513955ab9 00000100:00100000:2.0:1788263189.301303:0:8109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8109:1875129753686912:0@lo:502: 00002000:00100000:3.0:1788263189.301306:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9942421ad800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788263189.301310:0:6702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788263189.301314:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788263189.301344:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263189.301366:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753686912 00000100:00100000:2.0:1788263189.301374:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753686912 00000100:00100000:2.0:1788263189.301401:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263189.301407:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8109:x1875129753686912:12345-0@lo:502: 00002000:00100000:3.0:1788263189.301415:0:6702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788263189.301547:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788263189.301569:0:6702:0:(import.c:65:import_set_state_nolock()) ffff9942421af800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263189.301806:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8109:x1875129753686912:12345-0@lo:502: Request processed in 205us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.301814:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263189.301863:0:8109:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bccef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263189.301885:0:8109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8109:1875129753686912:0@lo:502: 00000020:01000000:2.0:1788263189.301908:0:8109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263189.301912:0:8109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263189.301913:0:8109:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788263189.301916:0:8109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1788263189.302415:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753687424:0@lo:400: 00000100:00100000:2.0:1788263189.302450:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263189.302474:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263189.302480:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753687040:0@lo:400: 00000100:00100000:2.0:1788263189.302500:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263189.302526:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753687168:0@lo:400: 00000100:00100000:2.0:1788263189.302549:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263189.302566:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263189.302572:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753687296:0@lo:400: 00000100:00100000:2.0:1788263189.302595:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263189.302626:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753687424 00000100:00100000:2.0:1788263189.302769:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753687424 00000100:00100000:2.0:1788263189.302813:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753687040 00000100:00100000:2.0:1788263189.302817:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753687040 00000100:00100000:2.0:1788263189.302828:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753687168 00000100:00100000:2.0:1788263189.302830:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753687168 00000100:00100000:2.0:1788263189.302931:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263189.303256:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753687424:12345-0@lo:400: 00000100:00100000:2.0:1788263189.303309:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753687424:12345-0@lo:400: Request processed in 58us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.303316:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263189.303334:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263189.303341:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753687040:12345-0@lo:400: 00000100:00100000:2.0:1788263189.303367:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753687040:12345-0@lo:400: Request processed in 27us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.303373:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263189.303385:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263189.303392:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753687168:12345-0@lo:400: 00000100:00100000:2.0:1788263189.303423:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753687168:12345-0@lo:400: Request processed in 32us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.303429:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263189.303457:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788263189.303464:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788263189.303477:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788263189.303563:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994380631880 x1875129753687168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263189.303577:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753687168:0@lo:400: 00010000:00080000:2.0:1788263189.303603:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994380630a80 x1875129753687040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263189.303612:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753687040:0@lo:400: 00010000:00080000:2.0:1788263189.303622:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994380633480 x1875129753687424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263189.303905:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753687424:0@lo:400: 00000100:00100000:1.0:1788263189.304184:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753687296 00000100:00100000:1.0:1788263189.304191:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753687296 00000100:00100000:1.0:1788263189.304257:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788263189.304265:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263189.304272:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753687296:12345-0@lo:400: 00000100:00100000:1.0:1788263189.304325:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753687296:12345-0@lo:400: Request processed in 54us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.304332:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788263189.304346:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788263189.304367:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994380633800 x1875129753687296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263189.304377:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380633800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753687296:0@lo:400: 00000020:01000000:1.0:1788263189.307346:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788263189.307381:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788263189.307393:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.307427:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263189.307438:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788263189.307441:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9943473c3370 from 1 10000000:01000000:1.0:1788263189.307445:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788263189.307482:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.307489:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263189.307500:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263189.307524:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753687552:0@lo:101: 00000100:00100000:1.0:1788263189.307593:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.307648:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce900 going to sleep for 11 seconds 00000100:00100000:2.0:1788263189.307714:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753687552 00000100:00100000:2.0:1788263189.307721:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753687552 00000100:00100000:2.0:1788263189.307773:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788263189.307781:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753687552:12345-0@lo:101: 00010000:00010000:2.0:1788263189.307793:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263189.307805:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955ac0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263189.307827:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955ac0 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263189.307836:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955ac0 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263189.307845:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216de00, rc 0) 00000100:00100000:2.0:1788263189.307886:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753687552:12345-0@lo:101: Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.307893:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788263189.307938:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753687552:0@lo:101: 00010000:00010000:2.0:1788263189.307952:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263189.308189:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263189.308276:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380633480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753687680:0@lo:501: 00000100:00100000:2.0:1788263189.308312:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263189.308326:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263189.308338:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753687680 00000100:00100000:2.0:1788263189.308341:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753687680 00000100:00100000:2.0:1788263189.308359:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788263189.308365:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753687680:12345-0@lo:501: 00000100:00100000:2.0:1788263189.308571:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753687680:12345-0@lo:501: Request processed in 205us (257us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788263189.308578:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788263189.308605:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380633480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753687680:0@lo:501: 10000000:01000000:2.0:1788263189.308629:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788263189.308635:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263189.308642:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263189.308847:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875129753686784:12345-0@lo:8: Request processed in 7605us (7700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263189.308929:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788263189.310549:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994380632d80 x1875129753686784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263189.310563:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263189.310571:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788263189.310581:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788263189.310587:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788263189.310591:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994342fd2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788263189.310658:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788263189.310665:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753686784:0@lo:8: 00000004:00080000:2.0:1788263189.311240:0:8110:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788263189.311390:0:8110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 216099171849ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788263189.356071:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788263189.406406:0:8111:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788263189.406437:0:8111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8111:1875129753687936:0@lo:7: 00000100:00100000:0.0:1788263189.406511:0:8111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.406571:0:8111:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263189.406594:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753687936 00000100:00100000:0.0:1788263189.406601:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753687936 00000100:00100000:0.0:1788263189.406673:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263189.406683:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8111:x1875129753687936:12345-0@lo:7: 00000100:00100000:1.0:1788263189.406784:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753687808:0@lo:13: 00000100:00100000:1.0:1788263189.406821:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788263189.409057:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263189.415465:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753687808 00000100:00100000:2.0:1788263189.415479:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753687808 00000100:00100000:2.0:1788263189.415542:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263189.415553:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753687808:12345-0@lo:13: 00002000:00000024:2.0:1788263189.415583:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788263189.416106:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753687808:12345-0@lo:13: Request processed in 383us (9112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.416116:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788263189.416436:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99438118aa00 x1875129753687808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263189.416461:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753687808:0@lo:13: 00002000:00080000:1.0:1788263189.422523:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788263189.422531:0:6705:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788263189.422829:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8111:x1875129753687936:12345-0@lo:7: Request processed in 16142us (16313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.422921:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788263189.423371:0:8111:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994381189c00 x1875129753687936/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788263205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263189.423389:0:8111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8111:1875129753687936:0@lo:7: 00000004:00080000:0.0:1788263189.423403:0:8111:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788263189.423452:0:8111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8111:1875129753688064:0@lo:5: 00000100:00100000:0.0:1788263189.423494:0:8111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.423556:0:8111:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263189.423812:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753688064 00000100:00100000:2.0:1788263189.423821:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753688064 00000100:00100000:2.0:1788263189.423944:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263189.423954:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8111:x1875129753688064:12345-0@lo:5: 00002000:00080000:2.0:1788263189.424100:0:8112:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788263189.424105:0:8112:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788263189.424454:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8111:x1875129753688064:12345-0@lo:5: Request processed in 501us (958us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788263189.424461:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788263189.424593:0:8111:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994381189c00 x1875129753688064/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263189.424607:0:8111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8111:1875129753688064:0@lo:5: 00000004:00080000:0.0:1788263189.424618:0:8111:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788263189.424796:0:8111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8111:1875129753688192:0@lo:700: 00000100:00100000:0.0:1788263189.424828:0:8111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263189.424968:0:8111:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788263189.425155:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753688192 00000100:00100000:1.0:1788263189.425161:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753688192 00000100:00100000:1.0:1788263189.425287:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263189.425297:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8111:x1875129753688192:12345-0@lo:700: 00000100:00100000:1.0:1788263189.425331:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1875129753688320:0@lo:700: 00000100:00100000:1.0:1788263189.425368:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.425383:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce300 going to sleep for 11 seconds 00000100:00100000:2.0:1788263189.425444:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753688320 00000100:00100000:2.0:1788263189.425448:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753688320 00000100:00100000:2.0:1788263189.425487:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263189.425495:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1875129753688320:12345-0@lo:700: 40000000:02000000:2.0:1788263189.482911:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788263189.502296:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1875129753688320:12345-0@lo:700: Request processed in 76792us (76918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263189.502320:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788263189.504626:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994346b26d80 x1875129753688320/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788263205 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263189.504647:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1875129753688320:0@lo:700: 40000000:02000000:2.0:1788263189.504667:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1788263189.597449:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1788263189.597667:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8111:x1875129753688192:12345-0@lo:700: Request processed in 172367us (172833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263189.597755:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:0.0:1788263189.597839:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1788263189.598067:0:8111:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994381188000 x1875129753688192/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788263205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263189.598081:0:8111:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788263189.598099:0:8111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8111:1875129753688192:0@lo:700: 00000004:02000040:1.0:1788263189.631561:0:8111:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788263189.634629:0:8111:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8111:1875129753688448:0@lo:5: 00000100:00100000:1.0:1788263189.634701:0:8111:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263189.635214:0:8111:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943507ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263189.635608:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753688448 00000100:00100000:3.0:1788263189.635616:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753688448 00000100:00100000:3.0:1788263189.635788:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788263189.635799:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8111:x1875129753688448:12345-0@lo:5: 00002000:00080000:3.0:1788263189.641799:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788263189.641820:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788263189.645659:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8111:x1875129753688448:12345-0@lo:5: Request processed in 9854us (10950us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788263189.645672:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788263189.645947:0:8111:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994346b24e00 x1875129753688448/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263205 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263189.646030:0:8111:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8111:1875129753688448:0@lo:5: 00000004:00080000:0.0:1788263189.646047:0:8111:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788263189.691498:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263190.267432:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263190.267564:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753688576:0@lo:13: 00000100:00100000:2.0:1788263190.267640:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263190.267804:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753688576 00000100:00100000:0.0:1788263190.267814:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753688576 00000100:00100000:0.0:1788263190.267862:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263190.267872:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753688576:12345-0@lo:13: 00002000:00000024:0.0:1788263190.267907:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263190.267965:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753688576:12345-0@lo:13: Request processed in 93us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263190.267972:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788263190.268213:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99438118ad80 x1875129753688576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263190.268267:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753688576:0@lo:13: 00010000:00010000:2.0:1788263190.716153:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263191.746620:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788263191.878132:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788263192.382325:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263192.382358:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735839872 00000100:00100000:3.0:1788263192.382367:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735839872 00000100:00100000:3.0:1788263192.382401:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:3.0:1788263192.382409:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875129735839872:12345-192.168.201.29@tcp:250: 00010000:00080000:3.0:1788263192.382434:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2b18c11e-0696-4540-97e4-82aaa1c0495b@192.168.201.29@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:3.0:1788263192.382466:0:5847:0:(genops.c:1385:class_connect()) connect: client 2b18c11e-0696-4540-97e4-82aaa1c0495b, cookie 0x1a657bc513955ace 00000100:00080000:3.0:1788263192.382591:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9942421ad000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263192.382650:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+5:2358:x1875129735839872:12345-192.168.201.29@tcp:250: Request processed in 241us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263192.382657:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:3.0:1788263192.390670:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263192.390704:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735840000 00000100:00100000:3.0:1788263192.390713:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735840000 00000100:00100000:3.0:1788263192.390762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:3.0:1788263192.390773:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+5:5585:x1875129735840000:12345-192.168.201.29@tcp:101: 00010000:00010000:3.0:1788263192.390790:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263192.390807:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2ef3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263192.390835:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ef3 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263192.390847:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ef3 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263192.390856:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943821f4e00, rc 0) 00000100:00100000:3.0:1788263192.390916:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+6:5585:x1875129735840000:12345-192.168.201.29@tcp:101: Request processed in 145us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263192.390923:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:1.0:1788263192.398104:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263192.398145:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735840128 00000100:00100000:1.0:1788263192.398157:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735840128 00000100:00100000:1.0:1788263192.398240:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:1.0:1788263192.398256:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+6:5585:x1875129735840128:12345-192.168.201.29@tcp:501: 00000100:00100000:1.0:1788263192.398592:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+6:5585:x1875129735840128:12345-192.168.201.29@tcp:501: Request processed in 339us (498us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263192.398600:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:3.0:1788263192.404114:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263192.404310:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735840256 00000100:00100000:2.0:1788263192.404328:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735840256 00000100:00100000:2.0:1788263192.404381:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:2.0:1788263192.404392:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+6:5585:x1875129735840256:12345-192.168.201.29@tcp:101: 00010000:00010000:2.0:1788263192.404408:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263192.404426:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2efa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263192.404458:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2efa expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263192.404469:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2efa expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263192.404479:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d800, rc 0) 00000100:00100000:2.0:1788263192.404534:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+7:5585:x1875129735840256:12345-192.168.201.29@tcp:101: Request processed in 144us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263192.404541:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:0.0:1788263192.410620:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263192.410695:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735840384 00000100:00100000:1.0:1788263192.410705:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735840384 00000100:00100000:1.0:1788263192.410764:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:1.0:1788263192.410776:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+7:5585:x1875129735840384:12345-192.168.201.29@tcp:501: 00000100:00100000:1.0:1788263192.411049:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:5585:x1875129735840384:12345-192.168.201.29@tcp:501: Request processed in 274us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263192.411056:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:1.0:1788263192.415689:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263192.415762:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735840512 00000100:00100000:3.0:1788263192.415772:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735840512 00000100:00100000:3.0:1788263192.415822:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:3.0:1788263192.415840:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:5585:x1875129735840512:12345-192.168.201.29@tcp:503: 00000100:00100000:3.0:1788263192.417027:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:5585:x1875129735840512:12345-192.168.201.29@tcp:503: Request processed in 1182us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263192.417038:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:3.0:1788263192.419702:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263192.419878:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735840640 00000100:00100000:0.0:1788263192.419889:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735840640 00000100:00100000:0.0:1788263192.419950:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:0.0:1788263192.419959:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:5604:x1875129735840640:12345-192.168.201.29@tcp:502: 00000100:00100000:0.0:1788263192.420311:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:5604:x1875129735840640:12345-192.168.201.29@tcp:502: Request processed in 351us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263192.420319:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:1.0:1788263192.468334:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263192.468529:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735840768 00000100:00100000:3.0:1788263192.468539:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735840768 00000100:00100000:2.0:1788263192.468708:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:2.0:1788263192.468723:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:5604:x1875129735840768:12345-192.168.201.29@tcp:502: 00000100:00100000:2.0:1788263192.469124:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:5604:x1875129735840768:12345-192.168.201.29@tcp:502: Request processed in 403us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263192.469132:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:1.0:1788263192.489280:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263192.489418:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735840896 00000100:00100000:3.0:1788263192.489428:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735840896 00000100:00100000:3.0:1788263192.489486:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:3.0:1788263192.489496:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:5585:x1875129735840896:12345-192.168.201.29@tcp:101: 00010000:00010000:3.0:1788263192.489513:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263192.489530:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943821f5200/0x1a657bc513955ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2f24 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263192.489558:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943821f5200/0x1a657bc513955ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f24 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263192.489570:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943821f5200/0x1a657bc513955ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f24 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263192.489579:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943821f5200, rc 0) 00000100:00100000:3.0:1788263192.489645:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5585:x1875129735840896:12345-192.168.201.29@tcp:101: Request processed in 149us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263192.489653:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:0.0:1788263192.495830:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263192.496083:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735841024 00000100:00100000:2.0:1788263192.496094:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735841024 00000100:00100000:2.0:1788263192.496188:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:2.0:1788263192.496200:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5585:x1875129735841024:12345-192.168.201.29@tcp:256: 20000000:01000000:2.0:1788263192.496263:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788263192.496293:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788263192.496297:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788263192.496300:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788263192.496302:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788263192.497960:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5585:x1875129735841024:12345-192.168.201.29@tcp:256: Request processed in 1754us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263192.497973:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:1.0:1788263192.501249:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263192.501331:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735841152 00000100:00100000:0.0:1788263192.501340:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735841152 00000100:00100000:0.0:1788263192.501417:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:0.0:1788263192.501427:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5585:x1875129735841152:12345-192.168.201.29@tcp:101: 00010000:00010000:0.0:1788263192.501446:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263192.501462:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2f2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263192.501491:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f2b expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263192.501502:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f2b expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263192.501511:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340030e00, rc 0) 00000100:00100000:0.0:1788263192.501565:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5585:x1875129735841152:12345-192.168.201.29@tcp:101: Request processed in 139us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263192.501572:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:3.0:1788263192.503519:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263192.503611:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735841280 00000100:00100000:0.0:1788263192.503634:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735841280 00000100:00100000:0.0:1788263192.503682:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:0.0:1788263192.503693:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5585:x1875129735841280:12345-192.168.201.29@tcp:501: 00000100:00100000:0.0:1788263192.504303:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5585:x1875129735841280:12345-192.168.201.29@tcp:501: Request processed in 611us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263192.504312:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:1.0:1788263192.506640:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263192.506759:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735841408 00000100:00100000:2.0:1788263192.506770:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735841408 00000100:00100000:2.0:1788263192.506881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:2.0:1788263192.506893:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5585:x1875129735841408:12345-192.168.201.29@tcp:503: 00000100:00100000:2.0:1788263192.507335:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5585:x1875129735841408:12345-192.168.201.29@tcp:503: Request processed in 443us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263192.507345:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:1.0:1788263192.511118:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263192.511250:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735841536 00000100:00100000:0.0:1788263192.511261:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735841536 00000100:00100000:0.0:1788263192.511349:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:0.0:1788263192.511359:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5609:x1875129735841536:12345-192.168.201.29@tcp:502: 00000100:00100000:0.0:1788263192.511635:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5609:x1875129735841536:12345-192.168.201.29@tcp:502: Request processed in 276us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263192.511643:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:1.0:1788263192.513604:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263192.513692:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735841664 00000100:00100000:2.0:1788263192.513701:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735841664 00000100:00100000:2.0:1788263192.513752:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:2.0:1788263192.513763:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5609:x1875129735841664:12345-192.168.201.29@tcp:502: 00000100:00100000:2.0:1788263192.514019:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5609:x1875129735841664:12345-192.168.201.29@tcp:502: Request processed in 258us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263192.514027:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:1.0:1788263192.517692:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263192.517877:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735841792 00000100:00100000:2.0:1788263192.517889:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735841792 00000100:00100000:2.0:1788263192.517946:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788263192.517955:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875129735841792:12345-192.168.201.29@tcp:38: 00010000:00080000:2.0:1788263192.517984:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:2.0:1788263192.518049:0:5853:0:(genops.c:1385:class_connect()) connect: client fedef325-db54-4469-b29a-301ff58466df, cookie 0x1a657bc513955af1 00000004:00100000:2.0:1788263192.518096:0:5853:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788263192.518102:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788263192.544636:0:5853:0:(import.c:65:import_set_state_nolock()) ffff994346b73000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263192.544774:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:2358:x1875129735841792:12345-192.168.201.29@tcp:38: Request processed in 26817us (27090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263192.544861:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00010000:00010000:2.0:1788263192.764160:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263193.550179:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263193.550262:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263193.550398:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735842048 00000100:00100000:3.0:1788263193.550410:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735842048 00000100:00100000:3.0:1788263193.550506:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735841920 00000100:00100000:3.0:1788263193.550511:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735841920 00000100:00100000:3.0:1788263193.550539:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263193.550550:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+7:5585:x1875129735842048:12345-192.168.201.29@tcp:41: 00000100:00100000:2.0:1788263193.550560:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788263193.550573:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+7:0:x1875129735841920:12345-192.168.201.29@tcp:41: 00000004:00000024:3.0:1788263193.550598:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:2.0:1788263193.550598:0:6725:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788263193.550675:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+7:0:x1875129735841920:12345-192.168.201.29@tcp:41: Request processed in 105us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263193.550683:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:1.0:1788263193.551092:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263193.558575:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:5585:x1875129735842048:12345-192.168.201.29@tcp:41: Request processed in 8012us (8392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263193.558593:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788263193.563793:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263193.563911:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735842176 00000100:00100000:0.0:1788263193.563922:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735842176 00000100:00100000:0.0:1788263193.564006:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1788263193.564017:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+6:5585:x1875129735842176:12345-192.168.201.29@tcp:40: 00000100:00100000:0.0:1788263193.564117:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+6:5585:x1875129735842176:12345-192.168.201.29@tcp:40: Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263193.564125:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788263193.568539:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263193.569136:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735842304 00000100:00100000:3.0:1788263193.569147:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735842304 00000100:00100000:3.0:1788263193.569199:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788263193.569208:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875129735842304:12345-192.168.201.29@tcp:8: 00010000:00080000:3.0:1788263193.569289:0:6702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1788263193.569325:0:6702:0:(genops.c:1385:class_connect()) connect: client fedef325-db54-4469-b29a-301ff58466df, cookie 0x1a657bc513955af8 00002000:00100000:3.0:1788263193.569338:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fedef325-db54-4469-b29a-301ff58466df/ffff9942421ac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788263193.569362:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788263193.572384:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263193.572436:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263193.572486:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263193.572570:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735842560 00000100:00100000:0.0:1788263193.572580:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735842560 00000100:00100000:0.0:1788263193.572646:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:0.0:1788263193.572659:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2362:x1875129735842560:12345-192.168.201.29@tcp:400: 00002000:00080000:2.0:1788263193.572707:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788263193.572742:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2362:x1875129735842560:12345-192.168.201.29@tcp:400: Request processed in 85us (304us total) trans 0 rc 0/0 00000100:00080000:2.0:1788263193.572747:0:6702:0:(import.c:65:import_set_state_nolock()) ffff99437cb23800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263193.572764:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:2.0:1788263193.572783:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:2358:x1875129735842304:12345-192.168.201.29@tcp:8: Request processed in 3573us (4253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263193.572794:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1788263193.572811:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735842688 00000100:00100000:2.0:1788263193.572816:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735842432 00000100:00100000:0.0:1788263193.572817:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735842688 00000100:00100000:2.0:1788263193.572823:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735842432 00000100:00100000:2.0:1788263193.572853:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263193.572858:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788263193.572864:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875129735842432:12345-192.168.201.29@tcp:8: 00000100:00100000:0.0:1788263193.572887:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+6:5585:x1875129735842688:12345-192.168.201.29@tcp:33: 00010000:00080000:2.0:1788263193.572888:0:6702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1788263193.572916:0:6702:0:(genops.c:1385:class_connect()) connect: client fedef325-db54-4469-b29a-301ff58466df, cookie 0x1a657bc513955aff 00002000:00100000:2.0:1788263193.572927:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fedef325-db54-4469-b29a-301ff58466df/ffff99437cb24000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788263193.572948:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788263193.573282:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788263193.573297:0:6702:0:(import.c:65:import_set_state_nolock()) ffff99437cb27000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263193.573335:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:2358:x1875129735842432:12345-192.168.201.29@tcp:8: Request processed in 474us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263193.573342:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000004:00080000:0.0:1788263193.603197:0:5855:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30239us 00000004:00200000:0.0:1788263193.641059:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788263193.641184:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+6:5585:x1875129735842688:12345-192.168.201.29@tcp:33: Request processed in 68297us (68692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263193.641195:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00010000:00010000:1.0:1788263193.791183:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263193.828784:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263193.828902:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735842816 00000100:00100000:2.0:1788263193.828912:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735842816 00000100:00100000:2.0:1788263193.828969:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788263193.829212:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:5627:x1875129735842816:12345-192.168.201.29@tcp:101: 00010000:00010000:2.0:1788263193.829255:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263193.829291:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513955b06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2f55 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263193.829357:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955b0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263193.829371:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955b0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263193.829385:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955b0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263193.829419:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263193.829422:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263193.829437:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955b0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263193.829463:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513955b06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f55 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263193.829502:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955b0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f55 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263193.829510:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99434314f500) 00010000:00010000:2.0:1788263193.829512:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263193.829515:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ca00, rc 0) 00000100:00100000:2.0:1788263193.829577:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+7:5627:x1875129735842816:12345-192.168.201.29@tcp:101: Request processed in 370us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263193.830511:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788263194.363764:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753688960:0@lo:400: 00000100:00100000:1.0:1788263194.363825:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753689088:0@lo:400: 00000100:00100000:3.0:1788263194.363845:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263194.363884:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263194.363921:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788263194.363930:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753688832:0@lo:400: 00000100:00100000:1.0:1788263194.363933:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788263194.363943:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753688704:0@lo:400: 00000100:00100000:3.0:1788263194.363959:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263194.364041:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753688960 00000100:00100000:0.0:1788263194.364049:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753688960 00000100:00100000:0.0:1788263194.364114:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753688832 00000100:00100000:0.0:1788263194.364117:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753688832 00000100:00100000:0.0:1788263194.364140:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263194.364148:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753688960:12345-0@lo:400: 00000100:00100000:2.0:1788263194.364236:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753689088 00000100:00100000:2.0:1788263194.364240:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753689088 00000100:00100000:2.0:1788263194.364284:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263194.364291:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753689088:12345-0@lo:400: 00000100:00100000:3.0:1788263194.370491:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753689344:0@lo:400: 00000100:00100000:3.0:1788263194.370582:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263194.370652:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753689344 00000100:00100000:3.0:1788263194.370660:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753689344 00000100:00100000:3.0:1788263194.370709:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263194.370721:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753689344:12345-0@lo:400: 00000100:00100000:3.0:1788263194.370768:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753689344:12345-0@lo:400: Request processed in 48us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263194.370772:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788263194.370807:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943473de300 x1875129753689344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263194.370815:0:3321:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788263194.370829:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753689344:0@lo:400: 00000100:00100000:3.0:1788263194.370860:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788263194.370865:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753688832:12345-0@lo:400: 00000100:00100000:3.0:1788263194.370889:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753688832:12345-0@lo:400: Request processed in 25us (6932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263194.370893:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788263194.370914:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753688832:0@lo:400: 00000100:00080000:3.0:1788263194.370942:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263194.370946:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263194.370949:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263194.372185:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263194.372369:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753689216:0@lo:400: 00000100:00100000:1.0:1788263194.372417:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263194.372463:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753689216 00000100:00100000:1.0:1788263194.372470:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753689216 00000100:00100000:1.0:1788263194.372516:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788263194.372524:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753689216:12345-0@lo:400: 00000100:00100000:1.0:1788263194.372568:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753689216:12345-0@lo:400: Request processed in 44us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263194.372574:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788263194.372592:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263194.372621:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753689216:0@lo:400: 00000100:00100000:0.0:1788263194.373195:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753688960:12345-0@lo:400: Request processed in 9044us (9347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263194.373204:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788263194.373355:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753689088:12345-0@lo:400: Request processed in 9064us (9480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263194.373365:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263194.374162:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753688960:0@lo:400: 00010000:00080000:0.0:1788263194.374245:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943473dce00 x1875129753689088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263194.374281:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753689088:0@lo:400: 00000100:00100000:3.0:1788263194.374563:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753688704 00000100:00100000:3.0:1788263194.374571:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753688704 00000100:00100000:3.0:1788263194.374617:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788263194.374626:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753688704:12345-0@lo:400: 00000100:00100000:3.0:1788263194.374688:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753688704:12345-0@lo:400: Request processed in 63us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263194.374697:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753688704:0@lo:400: 00000100:00100000:3.0:1788263194.374698:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:2.0:1788263194.811377:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263194.875730:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263194.875758:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753689472:0@lo:13: 00000100:00100000:2.0:1788263194.875845:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263194.879282:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753689472 00000100:00100000:0.0:1788263194.879313:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753689472 00000100:00100000:0.0:1788263194.879385:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263194.879396:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753689472:12345-0@lo:13: 00002000:00000024:0.0:1788263194.879421:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263194.879528:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753689472:12345-0@lo:13: Request processed in 134us (3683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263194.879536:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788263194.879687:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994381188700 x1875129753689472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263194.879709:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753689472:0@lo:13: 00000100:00100000:1.0:1788263195.387569:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753689600:0@lo:13: 00000100:00100000:1.0:1788263195.387662:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263195.387706:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753689600 00000100:00100000:0.0:1788263195.387715:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753689600 00000100:00100000:0.0:1788263195.387764:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263195.387776:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753689600:12345-0@lo:13: 00002000:00000024:0.0:1788263195.387810:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263195.387857:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753689600:12345-0@lo:13: Request processed in 84us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263195.387864:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788263195.388022:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994381188700 x1875129753689600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263195.388048:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753689600:0@lo:13: 00010000:00010000:1.0:1788263195.835483:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263195.970031:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263195.970583:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735842944 00000100:00100000:3.0:1788263195.970595:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735842944 00000100:00100000:3.0:1788263195.970694:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1788263195.970704:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+7:5679:x1875129735842944:12345-192.168.201.29@tcp:41: 00000004:00000024:3.0:1788263195.970746:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788263195.970816:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+7:5679:x1875129735842944:12345-192.168.201.29@tcp:41: Request processed in 113us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263195.970824:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00080000:1.0:1788263195.970936:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263195.977802:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263195.977991:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735843072 00000100:00100000:3.0:1788263195.978001:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735843072 00000100:00100000:3.0:1788263195.978067:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1788263195.978079:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fedef325-db54-4469-b29a-301ff58466df+6:5679:x1875129735843072:12345-192.168.201.29@tcp:13: 00002000:00000024:3.0:1788263195.978102:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263195.978171:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fedef325-db54-4469-b29a-301ff58466df+6:5679:x1875129735843072:12345-192.168.201.29@tcp:13: Request processed in 95us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263195.978179:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00080000:3.0:1788263195.978205:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788263195.981344:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000100:00100000:0.0:1788263195.981469:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263195.981647:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735843200 00000100:00100000:3.0:1788263195.981657:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735843200 00000100:00100000:3.0:1788263195.981727:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263195.981739:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fedef325-db54-4469-b29a-301ff58466df+6:5679:x1875129735843200:12345-192.168.201.29@tcp:13: 00002000:00000024:3.0:1788263195.981776:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263195.981843:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fedef325-db54-4469-b29a-301ff58466df+6:5679:x1875129735843200:12345-192.168.201.29@tcp:13: Request processed in 106us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263195.981851:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00080000:0.0:1788263195.982209:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788263196.863257:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263197.884427:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788263198.019706:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000001:00100000:0.0:1788263198.025012:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000001:02000400:3.0:1788263198.493381:0:8318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788263198.907621:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263198.950472:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263198.950533:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263198.950670:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735843328 00000100:00100000:1.0:1788263198.950690:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735843328 00000100:00100000:1.0:1788263198.950770:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:1.0:1788263198.950782:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2359:x1875129735843328:12345-192.168.201.29@tcp:400: 00000100:00100000:1.0:1788263198.950907:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2359:x1875129735843328:12345-192.168.201.29@tcp:400: Request processed in 111us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263198.950916:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:3.0:1788263198.951153:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263198.951187:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263198.951249:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735843456 00000100:00100000:1.0:1788263198.951254:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735843456 00000100:00100000:1.0:1788263198.951306:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1788263198.951314:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735843456:12345-192.168.201.29@tcp:400: 00000100:00100000:1.0:1788263198.951361:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735843456:12345-192.168.201.29@tcp:400: Request processed in 47us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263198.951368:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00080000:1.0:1788263198.951387:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263198.953102:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735843584 00000100:00100000:0.0:1788263198.953122:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735843584 00000100:00100000:0.0:1788263198.953280:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735843712 00000100:00100000:0.0:1788263198.953284:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735843712 00000100:00100000:3.0:1788263198.953345:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263198.953360:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735843584:12345-192.168.201.29@tcp:400: 00000100:00100000:3.0:1788263198.953451:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735843584:12345-192.168.201.29@tcp:400: Request processed in 95us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263198.953459:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00080000:1.0:1788263198.954148:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263198.954155:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263198.954318:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788263198.954331:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735843712:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1788263198.954408:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735843712:12345-192.168.201.29@tcp:400: Request processed in 80us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263198.954440:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788263199.484473:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753690112:0@lo:400: 00000100:00100000:3.0:1788263199.484567:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263199.484637:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788263199.484644:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753689728:0@lo:400: 00000100:00100000:3.0:1788263199.484677:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263199.484700:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753690240:0@lo:400: 00000100:00100000:3.0:1788263199.484727:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263199.484757:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753689856:0@lo:400: 00000100:00100000:3.0:1788263199.484782:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263199.484802:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753690368:0@lo:400: 00000100:00100000:3.0:1788263199.484823:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263199.484843:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263199.484849:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753689984:0@lo:400: 00000100:00100000:3.0:1788263199.484871:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263199.485057:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753690112 00000100:00100000:3.0:1788263199.485067:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753690112 00000100:00100000:3.0:1788263199.485132:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753690368 00000100:00100000:3.0:1788263199.485136:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753690368 00000100:00100000:3.0:1788263199.485164:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788263199.485189:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753690112:12345-0@lo:400: 00000100:00100000:3.0:1788263199.485280:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753690112:12345-0@lo:400: Request processed in 92us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263199.485289:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788263199.485448:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263199.485456:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753690368:12345-0@lo:400: 00000100:00100000:3.0:1788263199.486414:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753690368:12345-0@lo:400: Request processed in 953us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263199.486425:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263199.486466:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753689728 00000100:00100000:3.0:1788263199.486473:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753689728 00000100:00100000:3.0:1788263199.486513:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788263199.486521:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753689728:12345-0@lo:400: 00000100:00100000:3.0:1788263199.486572:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753689728:12345-0@lo:400: Request processed in 52us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263199.486579:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788263199.486613:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753690240 00000100:00100000:3.0:1788263199.486617:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753690240 00000100:00100000:3.0:1788263199.486648:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753689856 00000100:00100000:3.0:1788263199.486651:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753689856 00000100:00100000:3.0:1788263199.486662:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753689984 00000100:00100000:3.0:1788263199.486665:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753689984 00000100:00100000:3.0:1788263199.486682:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263199.486688:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753690240:12345-0@lo:400: 00000100:00100000:3.0:1788263199.486721:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753690240:12345-0@lo:400: Request processed in 34us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263199.486728:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263199.486739:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263199.486760:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753689856:12345-0@lo:400: 00000100:00100000:3.0:1788263199.486791:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753689856:12345-0@lo:400: Request processed in 32us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263199.486797:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263199.486809:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263199.486815:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753689984:12345-0@lo:400: 00000100:00100000:3.0:1788263199.486842:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753689984:12345-0@lo:400: Request processed in 27us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263199.486848:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788263199.486893:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263199.486900:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263199.486903:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263199.486961:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753689728:0@lo:400: 00000100:00100000:3.0:1788263199.486977:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753690240:0@lo:400: 00010000:00080000:3.0:1788263199.486992:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bfb480 x1875129753690112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263199.487004:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753690112:0@lo:400: 00010000:00080000:2.0:1788263199.489084:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bfb100 x1875129753690368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263199.489106:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753690368:0@lo:400: 00000100:00100000:2.0:1788263199.489140:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753689984:0@lo:400: 00000100:00100000:2.0:1788263199.489154:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753689856:0@lo:400: 00010000:00010000:0.0:1788263199.931823:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263199.997789:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753690496:0@lo:13: 00000100:00100000:3.0:1788263199.997862:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263199.997946:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753690496 00000100:00100000:3.0:1788263199.997954:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753690496 00000100:00100000:3.0:1788263199.997999:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263199.998008:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753690496:12345-0@lo:13: 00002000:00000024:3.0:1788263199.998042:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263199.999522:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753690496:12345-0@lo:13: Request processed in 1507us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263199.999541:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788263199.999602:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bfb480 x1875129753690496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263199.999756:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753690496:0@lo:13: 00000100:00100000:3.0:1788263200.520926:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753690624:0@lo:13: 00000100:00100000:3.0:1788263200.521026:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263200.521153:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753690624 00000100:00100000:0.0:1788263200.521164:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753690624 00000100:00100000:0.0:1788263200.521261:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263200.521274:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753690624:12345-0@lo:13: 00002000:00000024:0.0:1788263200.521324:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263200.521404:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753690624:12345-0@lo:13: Request processed in 131us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263200.521412:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788263200.521465:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994381189c00 x1875129753690624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263200.521490:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753690624:0@lo:13: 00010000:00010000:2.0:1788263200.973494:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788263201.916516:0:8465:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1ad23620 20000000:00000080:0.0:1788263201.916534:0:8465:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994375e15c00 uarg=0000000000000000 20000000:01000000:0.0:1788263201.916571:0:8465:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788263201.916574:0:8465:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788263201.916576:0:8465:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788263201.916581:0:8465:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788263201.916586:0:8465:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788263201.916599:0:8465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788263201.916602:0:8465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788263201.916785:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788263201.916953:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788263201.918491:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788263201.918985:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788263201.919065:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788263201.919106:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788263201.919123:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788263201.919125:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788263201.920172:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788263201.922491:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788263201.922558:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788263201.922593:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788263201.922607:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788263201.922609:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788263201.923776:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788263201.924551:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788263201.924603:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788263201.924650:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788263201.924663:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788263201.924666:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788263201.925323:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788263201.925692:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788263201.925742:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788263201.925780:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1788263201.925813:0:8465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788263201.925833:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925861:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a0a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925876:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a34 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925883:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a5e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925889:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a6c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925897:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a7a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925904:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a96 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925911:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955ac0 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925921:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ef3 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925929:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2efa expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925937:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.925979:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2efa expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.926006:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2efa expref: 9 pid: 5847 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.926022:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753690752:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263201.926433:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ef3 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.926444:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ef3 expref: 9 pid: 5844 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.926453:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753690880:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263201.926485:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955ac0 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.926493:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955ac0 expref: 18 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.926501:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691008:0@lo:104: 00000100:00100000:0.0:1788263201.926536:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263201.926572:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955a96 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.926580:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955a96 expref: 18 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.926588:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691136:0@lo:104: 00000100:00100000:0.0:1788263201.926611:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263201.926643:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955a7a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.926652:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955a7a expref: 18 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.926659:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691264:0@lo:104: 00010000:00010000:0.0:1788263201.926681:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955a6c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.926689:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955a6c expref: 18 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.926696:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691392:0@lo:104: 00010000:00010000:0.0:1788263201.926717:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955a5e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.926724:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955a5e expref: 18 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.926731:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691520:0@lo:104: 00010000:00010000:0.0:1788263201.926749:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955a34 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.926756:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955a34 expref: 18 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.926763:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691648:0@lo:104: 00010000:00010000:0.0:1788263201.926784:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955a0a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.926815:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955a0a expref: 18 pid: 5844 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.926824:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691776:0@lo:104: 00000100:00100000:0.0:1788263201.926859:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349852300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263201.926907:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788263201.926926:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263201.926938:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263201.926947:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263201.926954:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263201.926964:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263201.926972:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753691008 00000100:00100000:0.0:1788263201.926980:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753691008 00000100:00100000:0.0:1788263201.927017:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753691136 00000100:00100000:0.0:1788263201.927020:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753691136 00000100:00100000:0.0:1788263201.927030:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753691264 00000100:00100000:0.0:1788263201.927032:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753691264 00000100:00100000:0.0:1788263201.927042:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753691392 00000100:00100000:0.0:1788263201.927044:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753691392 00000100:00100000:0.0:1788263201.927052:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753691520 00000100:00100000:0.0:1788263201.927068:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753691520 00000100:00100000:0.0:1788263201.927079:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753691648 00000100:00100000:0.0:1788263201.927081:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753691648 00000100:00100000:0.0:1788263201.927089:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753691776 00000100:00100000:0.0:1788263201.927091:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753691776 00000100:00100000:0.0:1788263201.927105:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263201.927113:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:8465:x1875129753691008:12345-0@lo:104: 00010000:00010000:0.0:1788263201.927126:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927187:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263201.927194:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+9:8465:x1875129753691008:12345-0@lo:104: Request processed in 81us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.927201:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263201.927243:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263201.927249:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+8:8465:x1875129753691136:12345-0@lo:104: 00010000:00010000:0.0:1788263201.927258:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927292:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788263201.927297:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f67bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+8:8465:x1875129753691136:12345-0@lo:104: Request processed in 49us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.927303:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263201.927333:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263201.927339:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+7:8465:x1875129753691264:12345-0@lo:104: 00010000:00010000:0.0:1788263201.927347:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927372:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788263201.927377:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+7:8465:x1875129753691264:12345-0@lo:104: Request processed in 39us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.927383:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263201.927397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263201.927402:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+6:8465:x1875129753691392:12345-0@lo:104: 00010000:00010000:0.0:1788263201.927409:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927439:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788263201.927444:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+6:8465:x1875129753691392:12345-0@lo:104: Request processed in 42us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.927450:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263201.927461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263201.927466:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:8465:x1875129753691520:12345-0@lo:104: 00010000:00010000:0.0:1788263201.927473:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927495:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788263201.927499:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:8465:x1875129753691520:12345-0@lo:104: Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.927504:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263201.927513:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263201.927518:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:8465:x1875129753691648:12345-0@lo:104: 00010000:00010000:0.0:1788263201.927524:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927546:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788263201.927550:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:8465:x1875129753691648:12345-0@lo:104: Request processed in 33us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.927556:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263201.927566:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788263201.927571:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:8465:x1875129753691776:12345-0@lo:104: 00010000:00010000:0.0:1788263201.927577:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927610:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788263201.927615:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:8465:x1875129753691776:12345-0@lo:104: Request processed in 45us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.927621:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788263201.927639:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788263201.927644:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927651:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159a00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263201.927655:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927664:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263201.927671:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263201.927677:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263201.927705:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927712:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263201.927737:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927744:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc513955ac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955ac7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927765:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788263201.927768:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927773:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159e00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263201.927775:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927782:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263201.927789:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263201.927794:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263201.927806:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927811:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263201.927824:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927830:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927839:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788263201.927854:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927873:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158a00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263201.927876:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927882:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263201.927887:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263201.927892:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263201.927904:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927909:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263201.927914:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927920:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927928:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788263201.927931:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927937:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030a00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263201.927939:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927956:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263201.927962:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263201.927966:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263201.927981:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927986:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263201.927991:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.927997:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994340030a00/0x1a657bc513955a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a73 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928008:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788263201.928011:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928015:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031600 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263201.928018:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928023:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263201.928029:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263201.928039:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263201.928052:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928057:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263201.928062:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928067:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994340031600/0x1a657bc513955a5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928075:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263201.928078:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928083:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263201.928085:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928090:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263201.928095:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263201.928100:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263201.928110:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928115:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263201.928124:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928130:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513955a34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a3b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928138:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263201.928141:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928146:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031200 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263201.928149:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928155:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263201.928161:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263201.928167:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263201.928180:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928185:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263201.928189:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928195:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955a0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a11 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928208:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263201.928236:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263201.928239:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263201.928271:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691008:0@lo:104: 00000100:00100000:0.0:1788263201.928279:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691136:0@lo:104: 00000100:00100000:0.0:1788263201.928286:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691264:0@lo:104: 00000100:00100000:0.0:1788263201.928292:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691392:0@lo:104: 00000100:00100000:0.0:1788263201.928297:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691520:0@lo:104: 00000100:00100000:0.0:1788263201.928303:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691648:0@lo:104: 00000100:00100000:0.0:1788263201.928309:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753691776:0@lo:104: 00000100:00100000:0.0:1788263201.928341:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753692288:0@lo:103: 00000100:00100000:0.0:1788263201.928378:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263201.928403:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788263201.928408:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753691904:0@lo:103: 00000100:00100000:0.0:1788263201.928442:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263201.928460:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753692416:0@lo:103: 00000100:00100000:0.0:1788263201.928479:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263201.928514:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753692288 00000100:00100000:0.0:1788263201.928520:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753692288 00010000:00010000:0.0:1788263201.928542:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a6c expref: 19 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.928559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753691904 00000100:00100000:0.0:1788263201.928562:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753691904 00010000:00010000:0.0:1788263201.928571:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955ac0 expref: 20 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.928580:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753692416 00000100:00100000:0.0:1788263201.928588:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753692416 00010000:00010000:0.0:1788263201.928600:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a5e expref: 21 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.928615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263201.928621:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+21:3322:x1875129753692288:12345-0@lo:103: 00010000:00010000:0.0:1788263201.928632:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263201.928637:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a6c expref: 21 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928646:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955a6c expref: 21 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928660:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216d000/0x1a657bc513955a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955a6c expref: 21 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928675:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263201.928706:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+20:3322:x1875129753692288:12345-0@lo:103: Request processed in 85us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.928712:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263201.928725:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263201.928732:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753691904:12345-0@lo:103: 00010000:00010000:0.0:1788263201.928738:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263201.928743:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955ac0 expref: 19 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928751:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955ac0 expref: 19 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928762:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216de00/0x1a657bc513955ac7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955ac0 expref: 19 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928777:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263201.928800:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:3322:x1875129753691904:12345-0@lo:103: Request processed in 69us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.928805:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263201.928816:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263201.928822:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3322:x1875129753692416:12345-0@lo:103: 00010000:00010000:0.0:1788263201.928828:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263201.928831:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a5e expref: 17 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.928839:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955a5e expref: 17 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263201.929309:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753692032:0@lo:103: 00000100:00100000:3.0:1788263201.929338:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.929360:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753692544:0@lo:103: 00000100:00100000:3.0:1788263201.929374:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.929384:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788263201.929389:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753692160:0@lo:103: 00000100:00100000:3.0:1788263201.929402:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.929417:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753692672:0@lo:103: 00000100:00100000:3.0:1788263201.929438:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263201.929563:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788263201.929572:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788263201.929738:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753692032 00000100:00100000:1.0:1788263201.929742:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753692032 00010000:00010000:1.0:1788263201.929759:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a96 expref: 18 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263201.929773:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788263201.929777:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753692544 00000100:00100000:1.0:1788263201.929793:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753692544 00010000:00010000:1.0:1788263201.929805:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a34 expref: 19 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263201.929815:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788263201.929818:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753692160 00000100:00100000:1.0:1788263201.929820:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753692160 00010000:00010000:1.0:1788263201.929827:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a7a expref: 20 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263201.929835:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788263201.929838:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753692672 00000100:00100000:1.0:1788263201.929849:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753692672 00010000:00010000:1.0:1788263201.929859:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a0a expref: 21 pid: 5844 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263201.929869:0:5838:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788263201.929876:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263201.929881:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+21:3320:x1875129753692032:12345-0@lo:103: 00010000:00010000:1.0:1788263201.929889:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263201.929893:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a96 expref: 21 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263201.929987:0:8470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788263201.929992:0:8470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1788263201.930292:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263201.930956:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955a96 expref: 21 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.930973:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343159000/0x1a657bc513955a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955a96 expref: 21 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.930985:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263201.931044:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+20:3320:x1875129753692032:12345-0@lo:103: Request processed in 1162us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.931143:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753692032:0@lo:103: 00000100:00100000:1.0:1788263201.931195:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263201.931244:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263201.931255:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753692544:12345-0@lo:103: 00010000:00010000:1.0:1788263201.931269:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263201.931274:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a34 expref: 19 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.931284:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955a34 expref: 19 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.931294:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f4000/0x1a657bc513955a3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955a34 expref: 19 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.931304:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263201.931337:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:3320:x1875129753692544:12345-0@lo:103: Request processed in 85us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263201.931342:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263201.931353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263201.931358:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3320:x1875129753692160:12345-0@lo:103: 00010000:00010000:1.0:1788263201.931365:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263201.931369:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a7a expref: 17 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.931377:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955a7a expref: 17 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.931386:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343159200/0x1a657bc513955a81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955a7a expref: 17 pid: 5846 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.931402:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263201.931426:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3320:x1875129753692160:12345-0@lo:103: Request processed in 69us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263201.931432:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263201.931445:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788263201.931451:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:3320:x1875129753692672:12345-0@lo:103: 00010000:00010000:1.0:1788263201.931458:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263201.931462:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a0a expref: 15 pid: 5844 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.931470:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955a0a expref: 15 pid: 5844 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.931479:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216cc00/0x1a657bc513955a11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955a0a expref: 15 pid: 5844 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.931487:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263201.931505:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc93c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:3320:x1875129753692672:12345-0@lo:103: Request processed in 55us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263201.931510:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788263201.931580:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753692160:0@lo:103: 00000100:00100000:3.0:1788263201.931588:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753692672:0@lo:103: 00000100:00100000:3.0:1788263201.931714:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753692544:0@lo:103: 00010000:00010000:0.0:1788263201.931973:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f5600/0x1a657bc513955a65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955a5e expref: 13 pid: 5847 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.931985:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263201.932014:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:3322:x1875129753692416:12345-0@lo:103: Request processed in 3193us (3533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.932020:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263201.932130:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753691904:0@lo:103: 00000100:00100000:0.0:1788263201.932138:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753692416:0@lo:103: 00000100:00100000:0.0:1788263201.932145:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753692288:0@lo:103: 00000100:00100000:3.0:1788263201.933342:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263201.933418:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735843840 00000100:00100000:1.0:1788263201.933427:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735843840 00010000:00010000:1.0:1788263201.933453:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2efa expref: 10 pid: 5847 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263201.933483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1788263201.933492:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2361:x1875129735843840:12345-192.168.201.29@tcp:103: 00010000:00010000:1.0:1788263201.933517:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263201.933523:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2efa expref: 10 pid: 5847 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.933533:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2efa expref: 10 pid: 5847 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.933547:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263201.933607:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2361:x1875129735843840:12345-192.168.201.29@tcp:103: Request processed in 115us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263201.933614:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:0.0:1788263201.933702:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216d800/0x1a657bc513955adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2efa expref: 9 pid: 5847 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.933728:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753690752:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263201.933741:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875129753690880:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263201.933773:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263201.936908:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263201.936999:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735843968 00000100:00100000:0.0:1788263201.937011:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735843968 00010000:00010000:0.0:1788263201.937047:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ef3 expref: 9 pid: 5844 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263201.937089:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788263201.937099:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:2361:x1875129735843968:12345-192.168.201.29@tcp:103: 00010000:00010000:0.0:1788263201.937114:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263201.937120:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ef3 expref: 9 pid: 5844 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937132:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ef3 expref: 9 pid: 5844 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937149:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f4e00/0x1a657bc513955ad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ef3 expref: 9 pid: 5844 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937164:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937172:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937201:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937208:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937214:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937259:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937265:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263201.937270:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937278:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937293:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263201.937303:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263201.937359:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:2361:x1875129735843968:12345-192.168.201.29@tcp:103: Request processed in 261us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.937367:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00010000:00010000:1.0:1788263201.937446:0:8465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.937454:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263201.937460:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031e00/0x1a657bc513955b14 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263201.980778:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263202.125191:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263202.125309:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735844096 00000100:00100000:0.0:1788263202.125327:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735844096 00000100:00100000:3.0:1788263202.125444:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:0.0:1788263202.125983:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:5599:x1875129735844096:12345-192.168.201.29@tcp:101: 00010000:00010000:0.0:1788263202.126045:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263202.126075:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340031600/0x1a657bc513955b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2f5c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263202.126115:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031600/0x1a657bc513955b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f5c expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263202.126128:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340031600/0x1a657bc513955b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f5c expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263202.126140:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340031600, rc 0) 00000100:00100000:0.0:1788263202.126250:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5599:x1875129735844096:12345-192.168.201.29@tcp:101: Request processed in 792us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263202.126258:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:2.0:1788263202.131328:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263202.131421:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735844224 00000100:00100000:3.0:1788263202.131438:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735844224 00000100:00100000:3.0:1788263202.131515:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:3.0:1788263202.131525:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5599:x1875129735844224:12345-192.168.201.29@tcp:501: 00000100:00100000:0.0:1788263202.132568:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5599:x1875129735844224:12345-192.168.201.29@tcp:501: Request processed in 1037us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263202.132583:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:3.0:1788263202.136084:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263202.136341:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735844352 00000100:00100000:0.0:1788263202.136352:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735844352 00000100:00100000:0.0:1788263202.136407:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00100000:0.0:1788263202.136418:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5599:x1875129735844352:12345-192.168.201.29@tcp:503: 00000100:00100000:0.0:1788263202.136673:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5599:x1875129735844352:12345-192.168.201.29@tcp:503: Request processed in 255us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263202.136682:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00100000:3.0:1788263202.144954:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263202.145991:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735844480 00000100:00100000:0.0:1788263202.146003:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735844480 00000100:00100000:0.0:1788263202.146073:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:0.0:1788263202.146083:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:6068:x1875129735844480:12345-192.168.201.29@tcp:502: 00000100:00100000:0.0:1788263202.146467:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:6068:x1875129735844480:12345-192.168.201.29@tcp:502: Request processed in 384us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263202.146476:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:2.0:1788263202.150144:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263202.150248:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735844608 00000100:00100000:0.0:1788263202.150260:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735844608 00000100:00100000:0.0:1788263202.150316:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:0.0:1788263202.150326:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:6068:x1875129735844608:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263202.150614:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:6068:x1875129735844608:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 288us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263202.150622:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:3.0:1788263202.167549:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263202.168350:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735844736 00000100:00100000:0.0:1788263202.168363:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735844736 00000100:00100000:0.0:1788263202.168430:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:0.0:1788263202.168440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5599:x1875129735844736:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263202.168456:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263202.168476:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340030a00/0x1a657bc513955b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2f63 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263202.168505:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340030a00/0x1a657bc513955b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f63 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263202.168516:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340030a00/0x1a657bc513955b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f63 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263202.168526:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340030a00, rc 0) 00000100:00100000:0.0:1788263202.168593:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5599:x1875129735844736:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 154us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263202.168617:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:3.0:1788263202.170954:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263202.171162:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735844864 00000100:00100000:2.0:1788263202.171171:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735844864 00000100:00100000:2.0:1788263202.171245:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 136 00000100:00100000:2.0:1788263202.171256:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5599:x1875129735844864:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263202.171501:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5599:x1875129735844864:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 246us (555us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788263202.171510:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 136 00010000:00010000:2.0:1788263203.003428:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788263203.388911:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788263203.388918:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994375782000 from 39 10000000:01000000:0.0:1788263203.388924:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263203.388983:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.388995:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.389006:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263203.389031:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753692800:0@lo:101: 00000100:00100000:0.0:1788263203.389101:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.389169:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330480 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.389187:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753692800 00000100:00100000:1.0:1788263203.389196:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753692800 00000100:00100000:1.0:1788263203.389284:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788263203.389294:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+12:5849:x1875129753692800:12345-0@lo:101: 00010000:00010000:1.0:1788263203.389317:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263203.389331:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343159000/0x1a657bc513955b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955b29 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.389355:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343159000/0x1a657bc513955b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955b29 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.389380:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343159000/0x1a657bc513955b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955b29 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.389389:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159000, rc 0) 00000100:00100000:1.0:1788263203.389453:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753692800:12345-0@lo:101: Request processed in 159us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.389460:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788263203.389505:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753692800:0@lo:101: 00010000:00010000:3.0:1788263203.389521:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.389531:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263203.389677:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753692928:0@lo:501: 00000100:00100000:1.0:1788263203.389704:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263203.389730:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30540 going to sleep for 11 seconds 00000100:00100000:3.0:1788263203.389776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753692928 00000100:00100000:3.0:1788263203.389780:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753692928 00000100:00100000:3.0:1788263203.389810:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788263203.389826:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753692928:12345-0@lo:501: 00000100:00100000:3.0:1788263203.390094:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753692928:12345-0@lo:501: Request processed in 276us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263203.390102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788263203.390138:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753692928:0@lo:501: 00000100:00100000:0.0:1788263203.390171:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753693056:0@lo:503: 00000100:00100000:0.0:1788263203.390210:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.390254:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.390332:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753693056 00000100:00100000:1.0:1788263203.390336:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753693056 00000100:00100000:1.0:1788263203.390368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788263203.390375:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753693056:12345-0@lo:503: 00000100:00100000:1.0:1788263203.390527:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753693056:12345-0@lo:503: Request processed in 152us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.390535:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788263203.390561:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753693056:0@lo:503: 00000100:00100000:2.0:1788263203.391871:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8493:1875129753693184:0@lo:502: 00000100:00100000:2.0:1788263203.391929:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263203.391968:0:8493:0:(client.c:2715:ptlrpc_set_wait()) set ffff994347cebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.392344:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753693184 00000100:00100000:1.0:1788263203.392351:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753693184 00000100:00100000:1.0:1788263203.392396:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788263203.392405:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:8493:x1875129753693184:12345-0@lo:502: 00000100:00100000:1.0:1788263203.392641:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:8493:x1875129753693184:12345-0@lo:502: Request processed in 236us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.392649:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788263203.392797:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8493:1875129753693184:0@lo:502: 00000100:00100000:2.0:1788263203.392863:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8493:1875129753693312:0@lo:502: 00000100:00100000:2.0:1788263203.392896:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263203.392925:0:8493:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349694900 going to sleep for 11 seconds 00000100:00100000:3.0:1788263203.394525:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753693312 00000100:00100000:3.0:1788263203.394537:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753693312 00000100:00100000:3.0:1788263203.394585:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788263203.394594:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:8493:x1875129753693312:12345-0@lo:502: 00000100:00100000:3.0:1788263203.395378:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:8493:x1875129753693312:12345-0@lo:502: Request processed in 782us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263203.395387:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788263203.396143:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8493:1875129753693312:0@lo:502: 00000040:00080000:2.0:1788263203.396185:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788263203.397587:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788263203.397616:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788263203.397627:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.397638:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263203.397656:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788263203.397659:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788263203.397662:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788263203.397699:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.397706:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.397716:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263203.398069:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753693440:0@lo:101: 00000100:00100000:0.0:1788263203.398132:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.398177:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.398388:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753693440 00000100:00100000:2.0:1788263203.398396:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753693440 00000100:00100000:2.0:1788263203.398439:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788263203.398448:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+13:5849:x1875129753693440:12345-0@lo:101: 00010000:00010000:2.0:1788263203.398461:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263203.398474:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d6800/0x1a657bc513955b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955b37 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.399186:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d6800/0x1a657bc513955b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955b37 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.399199:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d6800/0x1a657bc513955b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955b37 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.399208:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6800, rc 0) 00000100:00100000:2.0:1788263203.399281:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753693440:12345-0@lo:101: Request processed in 833us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.399460:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788263203.399851:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753693440:0@lo:101: 00010000:00010000:2.0:1788263203.399869:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.399891:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263203.399960:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753693568:0@lo:501: 00000100:00100000:2.0:1788263203.400208:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263203.400460:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349694240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.400563:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753693568 00000100:00100000:1.0:1788263203.400569:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753693568 00000100:00100000:1.0:1788263203.400647:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788263203.400656:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753693568:12345-0@lo:501: 00000100:00100000:1.0:1788263203.401399:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753693568:12345-0@lo:501: Request processed in 740us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.401408:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788263203.401478:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753693568:0@lo:501: 00000100:00100000:2.0:1788263203.401514:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753693696:0@lo:503: 00000100:00100000:2.0:1788263203.401562:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263203.401629:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349694240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263203.401662:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753693696 00000100:00100000:0.0:1788263203.401667:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753693696 00000100:00100000:0.0:1788263203.401954:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788263203.401964:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753693696:12345-0@lo:503: 00000100:00100000:0.0:1788263203.405071:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753693696:12345-0@lo:503: Request processed in 3097us (3498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.405087:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788263203.405691:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380631880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753693696:0@lo:503: 00000100:00100000:3.0:1788263203.406862:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8495:1875129753693824:0@lo:502: 00000100:00100000:3.0:1788263203.406957:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263203.407034:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.407130:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753693824 00000100:00100000:1.0:1788263203.407137:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753693824 00000100:00100000:1.0:1788263203.407254:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788263203.407265:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:8495:x1875129753693824:12345-0@lo:502: 00000100:00100000:1.0:1788263203.407497:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:8495:x1875129753693824:12345-0@lo:502: Request processed in 233us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.407505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788263203.407595:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8495:1875129753693824:0@lo:502: 00000020:01000000:3.0:1788263203.407625:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263203.407636:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263203.407639:0:8495:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788263203.407644:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788263203.407668:0:8495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8495:1875129753693952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263203.407702:0:8495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263203.408012:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753693952 00000100:00100000:2.0:1788263203.408018:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753693952 00000100:00100000:2.0:1788263203.408185:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788263203.408194:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:8495:x1875129753693952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263203.408349:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:8495:x1875129753693952:12345-0@lo:502:llog_process_th.0 Request processed in 156us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.408354:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788263203.408937:0:8495:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcc50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263203.408959:0:8495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8495:1875129753693952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263203.408989:0:8495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263203.408995:0:8495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263203.408997:0:8495:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788263203.409008:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788263203.409186:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788263203.409214:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788263203.409294:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.409306:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263203.409318:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788263203.409321:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99438144e800 from 39 10000000:01000000:1.0:1788263203.409324:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788263203.409355:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.409368:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.409384:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263203.409403:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.409447:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263203.409479:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.410171:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753694080 00000100:00100000:2.0:1788263203.410178:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753694080 00000100:00100000:2.0:1788263203.410213:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788263203.410435:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:5849:x1875129753694080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263203.410445:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263203.410457:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d7a00/0x1a657bc513955b4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955b45 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.410486:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d7a00/0x1a657bc513955b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955b45 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.410497:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d7a00/0x1a657bc513955b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955b45 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.410505:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7a00, rc 0) 00000100:00100000:2.0:1788263203.410556:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753694080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.410562:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788263203.410577:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263203.410591:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.410601:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263203.410656:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.410684:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263203.410725:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.411110:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753694208 00000100:00100000:2.0:1788263203.411114:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753694208 00000100:00100000:2.0:1788263203.411139:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788263203.411145:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753694208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263203.411843:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753694208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 695us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.411851:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788263203.411927:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.411964:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.412006:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263203.412129:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.412429:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753694336 00000100:00100000:2.0:1788263203.412435:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753694336 00000100:00100000:2.0:1788263203.412505:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788263203.412513:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753694336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263203.412692:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753694336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.412699:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788263203.412763:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263203.413552:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8496:1875129753694464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263203.413606:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263203.413643:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349afd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263203.413706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753694464 00000100:00100000:0.0:1788263203.413711:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753694464 00000100:00100000:0.0:1788263203.413749:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788263203.413757:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:8496:x1875129753694464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263203.413978:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:8496:x1875129753694464:12345-0@lo:502:llog_process_th.0 Request processed in 221us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.413985:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788263203.414068:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8496:1875129753694464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263203.414113:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8496:1875129753694592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263203.414146:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263203.414170:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.414446:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753694592 00000100:00100000:1.0:1788263203.414452:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753694592 00000100:00100000:1.0:1788263203.414487:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788263203.414495:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:8496:x1875129753694592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263203.414652:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:8496:x1875129753694592:12345-0@lo:502:llog_process_th.0 Request processed in 157us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.414666:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788263203.414743:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8496:1875129753694592:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788263203.414764:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788263203.415114:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788263203.415140:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263203.415151:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.415162:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263203.415173:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788263203.415177:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788263203.415180:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788263203.415207:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.415351:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.415363:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263203.415381:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.415414:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263203.415442:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30180 going to sleep for 11 seconds 00000100:00100000:0.0:1788263203.415515:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753694720 00000100:00100000:0.0:1788263203.415521:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753694720 00000100:00100000:0.0:1788263203.415544:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788263203.415551:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:5849:x1875129753694720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263203.415562:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263203.415575:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340031000/0x1a657bc513955b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955b53 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.415599:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031000/0x1a657bc513955b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955b53 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.415610:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340031000/0x1a657bc513955b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955b53 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.415617:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340031000, rc 0) 00000100:00100000:0.0:1788263203.415652:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753694720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.415659:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788263203.415692:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263203.415706:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.415722:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263203.415768:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263203.415792:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.415808:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263203.415830:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753694848 00000100:00100000:0.0:1788263203.415834:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753694848 00000100:00100000:0.0:1788263203.415851:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788263203.415857:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753694848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.416955:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753694848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1092us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.416966:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788263203.417031:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263203.417549:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263203.417599:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.417671:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.417748:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753694976 00000100:00100000:1.0:1788263203.417755:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753694976 00000100:00100000:1.0:1788263203.417838:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788263203.417848:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753694976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.418022:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753694976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.418030:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788263203.418106:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753694976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263203.418709:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8497:1875129753695104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263203.418755:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.418788:0:8497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943723306c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.418843:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753695104 00000100:00100000:2.0:1788263203.418849:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753695104 00000100:00100000:2.0:1788263203.418890:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788263203.418898:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:8497:x1875129753695104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263203.419079:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:8497:x1875129753695104:12345-0@lo:502:llog_process_th.0 Request processed in 181us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.419086:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788263203.419329:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8497:1875129753695104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263203.419354:0:8497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263203.419365:0:8497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263203.419367:0:8497:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788263203.419374:0:8497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788263203.419396:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8497:1875129753695232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263203.419436:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.419461:0:8497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943723306c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.419539:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753695232 00000100:00100000:2.0:1788263203.419544:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753695232 00000100:00100000:2.0:1788263203.419576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788263203.419583:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:8497:x1875129753695232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263203.419719:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:8497:x1875129753695232:12345-0@lo:502:llog_process_th.0 Request processed in 135us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.419726:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788263203.419832:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8497:1875129753695232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263203.419852:0:8497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263203.419856:0:8497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263203.419858:0:8497:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788263203.419862:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788263203.420403:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788263203.420422:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788263203.420434:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.420445:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263203.420454:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788263203.420457:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994350979800 from 39 10000000:01000000:2.0:1788263203.420460:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788263203.420489:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.420497:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.420518:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263203.420535:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753695360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263203.420569:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263203.420636:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.420713:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753695360 00000100:00100000:1.0:1788263203.420718:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753695360 00000100:00100000:1.0:1788263203.420747:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788263203.420755:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753695360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263203.420765:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263203.420779:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343159200/0x1a657bc513955b68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955b61 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.420800:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343159200/0x1a657bc513955b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955b61 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.420810:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343159200/0x1a657bc513955b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955b61 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.420829:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159200, rc 0) 00000100:00100000:1.0:1788263203.420871:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753695360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.420877:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788263203.420987:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753695360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263203.420999:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.421008:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263203.421064:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753695488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263203.421090:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.421112:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943723306c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.421205:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753695488 00000100:00100000:1.0:1788263203.421209:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753695488 00000100:00100000:1.0:1788263203.421271:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788263203.421278:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753695488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.421498:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753695488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.421512:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788263203.421704:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753695488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263203.421733:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753695616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263203.421770:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.421788:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943723306c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.422117:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753695616 00000100:00100000:1.0:1788263203.422122:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753695616 00000100:00100000:1.0:1788263203.422174:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788263203.422180:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753695616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.422382:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753695616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.422387:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788263203.422443:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753695616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263203.422778:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8498:1875129753695744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263203.422831:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263203.422859:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263203.422910:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753695744 00000100:00100000:0.0:1788263203.422914:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753695744 00000100:00100000:0.0:1788263203.422929:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788263203.422933:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:8498:x1875129753695744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263203.423088:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:8498:x1875129753695744:12345-0@lo:502:llog_process_th.0 Request processed in 153us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.423095:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788263203.423332:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8498:1875129753695744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263203.423369:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8498:1875129753695872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263203.423393:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263203.423402:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263203.423526:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753695872 00000100:00100000:0.0:1788263203.423530:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753695872 00000100:00100000:0.0:1788263203.423548:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788263203.423554:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:8498:x1875129753695872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263203.423683:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:8498:x1875129753695872:12345-0@lo:502:llog_process_th.0 Request processed in 128us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.423690:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788263203.425192:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8498:1875129753695872:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788263203.425267:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788263203.425609:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788263203.425633:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263203.425644:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.425655:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263203.425665:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788263203.425668:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788263203.425671:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788263203.425711:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.425719:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.425730:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263203.425751:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.425813:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263203.425862:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.425908:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753696000 00000100:00100000:2.0:1788263203.425914:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753696000 00000100:00100000:2.0:1788263203.425987:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788263203.425996:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753696000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263203.426008:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263203.426023:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d7400/0x1a657bc513955b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955b6f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.426056:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d7400/0x1a657bc513955b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955b6f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.426073:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d7400/0x1a657bc513955b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955b6f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.426081:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7400, rc 0) 00000100:00100000:2.0:1788263203.426120:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753696000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.426126:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788263203.426275:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263203.426288:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.426297:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263203.426344:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263203.426371:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263203.428130:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.428306:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753696128 00000100:00100000:1.0:1788263203.428315:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753696128 00000100:00100000:1.0:1788263203.428368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788263203.428376:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753696128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.428672:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753696128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.428680:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788263203.428906:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.428959:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.429004:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263203.429065:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30540 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.429082:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753696256 00000100:00100000:1.0:1788263203.429086:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753696256 00000100:00100000:3.0:1788263203.429306:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788263203.429315:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753696256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263203.429493:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753696256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263203.429501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788263203.429868:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263203.430384:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8500:1875129753696384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263203.430441:0:8500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263203.430511:0:8500:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263203.430637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753696384 00000100:00100000:1.0:1788263203.430643:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753696384 00000100:00100000:1.0:1788263203.430714:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788263203.430733:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8500:x1875129753696384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263203.430947:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8500:x1875129753696384:12345-0@lo:502:llog_process_th.0 Request processed in 215us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.430954:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788263203.431083:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8500:1875129753696384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263203.431112:0:8500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263203.431125:0:8500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263203.431127:0:8500:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788263203.431135:0:8500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788263203.431158:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8500:1875129753696512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263203.431191:0:8500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263203.431458:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753696512 00000100:00100000:3.0:1788263203.431463:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753696512 00000100:00100000:3.0:1788263203.431500:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788263203.431507:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8500:x1875129753696512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263203.431648:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8500:x1875129753696512:12345-0@lo:502:llog_process_th.0 Request processed in 140us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263203.431655:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788263203.431878:0:8500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.431895:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8500:1875129753696512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263203.431916:0:8500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263203.431921:0:8500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263203.431922:0:8500:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788263203.431927:0:8500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788263203.439913:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788263203.439950:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788263203.439966:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.439978:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263203.439988:0:5849:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788263203.439992:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9943473c3370 from 1 10000000:01000000:1.0:1788263203.439995:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788263203.440034:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.440042:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263203.440053:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263203.440080:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.440151:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263203.440205:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.440330:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753696640 00000100:00100000:2.0:1788263203.440339:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753696640 00000100:00100000:2.0:1788263203.440393:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788263203.440403:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753696640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263203.440417:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263203.440430:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d7200/0x1a657bc513955b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955b7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.440460:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d7200/0x1a657bc513955b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955b7d expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.440469:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d7200/0x1a657bc513955b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955b7d expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.440478:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7200, rc 0) 00000100:00100000:2.0:1788263203.440531:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753696640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.440538:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788263203.440580:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263203.440593:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b84 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.440601:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b84 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263203.440650:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263203.440675:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263203.440688:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263203.440700:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753696768 00000100:00100000:2.0:1788263203.440704:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753696768 00000100:00100000:2.0:1788263203.440740:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788263203.440747:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753696768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263203.440983:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753696768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (306us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788263203.440998:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788263203.441032:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753696768:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788263203.441056:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788263203.441062:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b84 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.441070:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b84 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788263203.798804:0:8528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdadce0050 20000000:00000080:3.0:1788263203.798842:0:8528:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9943812b4000 uarg=0000000000000000 20000000:01000000:3.0:1788263203.798894:0:8528:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788263203.798901:0:8528:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788263203.798908:0:8528:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788263203.801791:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788263203.802058:0:8528:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788263203.807149:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788263203.807299:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788263203.807364:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788263203.807388:0:8528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788263203.807413:0:8528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.807436:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943821f4600/0x1a657bc513955954 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395594d expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.807445:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139559cb expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.807453:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955a26 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.807472:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f2b expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.807480:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.807535:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f2b expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.807556:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f2b expref: 9 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263203.807574:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875129753696896:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263203.807704:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955a26 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.807714:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955a26 expref: 18 pid: 5844 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263203.807724:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875129753697024:0@lo:104: 00000100:00100000:3.0:1788263203.807772:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263203.807823:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139559cb expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.807831:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139559cb expref: 18 pid: 5846 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263203.807839:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875129753697152:0@lo:104: 00000100:00100000:3.0:1788263203.807875:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263203.807923:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788263203.807954:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753697024 00000100:00100000:3.0:1788263203.807963:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753697024 00000100:00100000:3.0:1788263203.808008:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753697152 00000100:00100000:3.0:1788263203.808011:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753697152 00000100:00100000:3.0:1788263203.808025:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788263203.808033:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:8528:x1875129753697024:12345-0@lo:104: 00010000:00010000:3.0:1788263203.808048:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808099:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263203.808105:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:8528:x1875129753697024:12345-0@lo:104: Request processed in 73us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263203.808113:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788263203.808133:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263203.808139:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376174050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:8528:x1875129753697152:12345-0@lo:104: 00010000:00010000:3.0:1788263203.808146:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808178:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788263203.808183:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376174050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:8528:x1875129753697152:12345-0@lo:104: Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263203.808189:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788263203.808263:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263203.808269:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808277:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158000 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:3.0:1788263203.808290:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808300:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263203.808307:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263203.808313:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788263203.808344:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808350:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263203.808369:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808376:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158000/0x1a657bc513955a26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955a2d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808390:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263203.808394:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808400:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216c200 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:3.0:1788263203.808403:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808410:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263203.808426:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263203.808431:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788263203.808445:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808451:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263203.808458:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808464:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc5139559cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139559d2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808474:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263203.808475:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263203.808477:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263203.808506:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943821f4600/0x1a657bc513955954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc51395594d expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808516:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9943821f4600/0x1a657bc513955954 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc51395594d expref: 18 pid: 5847 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263203.808525:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875129753697536:0@lo:104: 00000100:00100000:3.0:1788263203.808550:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263203.808572:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753697536 00000100:00100000:3.0:1788263203.808577:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753697536 00000100:00100000:3.0:1788263203.808595:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263203.808601:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:8528:x1875129753697536:12345-0@lo:104: 00010000:00010000:3.0:1788263203.808617:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808650:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263203.808656:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:8528:x1875129753697536:12345-0@lo:104: Request processed in 54us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263203.808663:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788263203.808678:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263203.808683:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808689:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d400 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:3.0:1788263203.808692:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808699:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263203.808705:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263203.808711:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788263203.808725:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808731:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263203.808747:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808753:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216d400/0x1a657bc51395594d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955954 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263203.808774:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263203.808776:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263203.808777:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263203.808792:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753697664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263203.808834:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263203.808876:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263203.808900:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875129753697024:0@lo:104: 00000100:00100000:3.0:1788263203.808909:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875129753697152:0@lo:104: 00000100:00100000:3.0:1788263203.808914:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875129753697536:0@lo:104: 00000100:00100000:0.0:1788263203.809436:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753697280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263203.809473:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.809497:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263203.809502:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753697408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263203.809523:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263203.809553:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753697664 00000100:00100000:0.0:1788263203.809558:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753697664 00010000:00010000:0.0:1788263203.809580:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943821f4600/0x1a657bc513955954 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395594d expref: 19 pid: 5847 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263203.809602:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753697280 00000100:00100000:0.0:1788263203.809604:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753697280 00010000:00010000:0.0:1788263203.809615:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a26 expref: 20 pid: 5844 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263203.809629:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753697408 00000100:00100000:0.0:1788263203.809631:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753697408 00010000:00010000:0.0:1788263203.809640:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139559cb expref: 21 pid: 5846 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263203.809663:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788263203.809670:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:33366ce6-2c46-49eb-9afc-8617712bc2f4+21:3320:x1875129753697664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263203.809683:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263203.809690:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943821f4600/0x1a657bc513955954 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395594d expref: 21 pid: 5847 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.809700:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943821f4600/0x1a657bc513955954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc51395594d expref: 21 pid: 5847 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.809717:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f4600/0x1a657bc513955954 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc51395594d expref: 21 pid: 5847 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.809732:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263203.809765:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:33366ce6-2c46-49eb-9afc-8617712bc2f4+20:3320:x1875129753697664:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.809772:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788263203.809787:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263203.809793:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753697280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263203.809800:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263203.809804:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955a26 expref: 19 pid: 5844 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.809826:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955a26 expref: 19 pid: 5844 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.809836:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216c000/0x1a657bc513955a2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955a26 expref: 19 pid: 5844 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.809856:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263203.809883:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:3322:x1875129753697280:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.809889:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263203.809901:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263203.809907:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3322:x1875129753697408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263203.809914:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263203.809918:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139559cb expref: 17 pid: 5846 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.809926:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139559cb expref: 17 pid: 5846 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.809936:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343158400/0x1a657bc5139559d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139559cb expref: 17 pid: 5846 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.809945:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263203.809965:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3322:x1875129753697408:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.809971:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263203.810012:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753697664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263203.810038:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753697408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263203.810045:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753697280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263203.810353:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263203.816004:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875129753696896:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263203.816059:0:8528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263203.816129:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263203.816289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263203.818295:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735844992 00000100:00100000:0.0:1788263203.818313:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735844992 00010000:00010000:0.0:1788263203.818377:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f2b expref: 10 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263203.818434:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:0.0:1788263203.818446:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2361:x1875129735844992:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263203.818466:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263203.818473:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f2b expref: 10 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818488:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f2b expref: 10 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818512:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340030e00/0x1a657bc513955aea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f2b expref: 10 pid: 5847 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818535:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818544:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818576:0:8471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818584:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818610:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818617:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818623:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f5c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263203.818628:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818638:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818658:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818670:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263203.818740:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:2361:x1875129735844992:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 295us (2450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.818748:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00010000:00010000:0.0:1788263203.818787:0:8528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818797:0:8528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263203.818803:0:8528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f5c00/0x1a657bc513955b8b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263203.821028:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735845120 00000100:00100000:2.0:1788263203.821045:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735845120 00000100:00100000:2.0:1788263203.821123:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:2.0:1788263203.821137:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+9:5599:x1875129735845120:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263203.821170:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263203.821197:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2f6a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.821279:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f6a expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.821294:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f6a expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263203.821304:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6600, rc 0) 00000100:00100000:2.0:1788263203.821370:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5599:x1875129735845120:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 236us (5838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.821391:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:2.0:1788263203.828574:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263203.828658:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735845248 00000100:00100000:1.0:1788263203.828671:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735845248 00000100:00100000:1.0:1788263203.828737:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 170 00000100:00100000:1.0:1788263203.828749:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5599:x1875129735845248:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.829140:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5599:x1875129735845248:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 390us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.829157:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 170 00000100:00100000:3.0:1788263203.834106:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263203.834467:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735845376 00000100:00100000:1.0:1788263203.834482:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735845376 00000100:00100000:1.0:1788263203.834564:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:1.0:1788263203.834579:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5599:x1875129735845376:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263203.834889:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:5599:x1875129735845376:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 312us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263203.834899:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:3.0:1788263203.843415:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263203.843502:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735845504 00000100:00100000:0.0:1788263203.843540:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735845504 00000100:00100000:0.0:1788263203.843641:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:0.0:1788263203.843657:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:6085:x1875129735845504:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263203.843993:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:6085:x1875129735845504:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 338us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263203.844002:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:3.0:1788263203.847989:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263203.848174:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735845632 00000100:00100000:2.0:1788263203.848185:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735845632 00000100:00100000:2.0:1788263203.848279:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:2.0:1788263203.848291:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:6085:x1875129735845632:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263203.848566:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:6085:x1875129735845632:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 276us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263203.848575:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 173 00010000:00010000:3.0:1788263204.028538:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263204.073501:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263204.073556:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263204.073659:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263204.073710:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735845760 00000100:00100000:3.0:1788263204.073719:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735845760 00000100:00100000:3.0:1788263204.073797:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:3.0:1788263204.073817:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735845760:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263204.073897:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735845760:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 91us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263204.073905:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00080000:1.0:1788263204.074235:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263204.074732:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735846016 00000100:00100000:0.0:1788263204.074739:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735846016 00000100:00100000:0.0:1788263204.074797:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735845888 00000100:00100000:0.0:1788263204.074800:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735845888 00000100:00100000:0.0:1788263204.074837:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263204.074846:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735846016:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263204.074894:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735846016:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 49us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263204.074901:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263204.074915:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:0.0:1788263204.074921:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735845888:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263204.074946:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735845888:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263204.074952:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00080000:1.0:1788263204.075081:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263204.075085:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263204.605257:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753697920:0@lo:400:kworker.0 00000100:00100000:1.0:1788263204.605351:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263204.605417:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753698432:0@lo:400:kworker.0 00000100:00100000:1.0:1788263204.605445:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263204.605477:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263204.605483:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753698048:0@lo:400:kworker.0 00000100:00100000:1.0:1788263204.605504:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263204.605548:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753697920 00000100:00100000:1.0:1788263204.605556:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753697920 00000100:00100000:2.0:1788263204.605783:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753697792:0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.605906:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263204.605932:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753698304:0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.605954:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263204.605971:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263204.605977:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753698176:0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.606012:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263204.606044:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753697792 00000100:00100000:2.0:1788263204.606048:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753697792 00000100:00100000:2.0:1788263204.606096:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788263204.606106:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3321:x1875129753697792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.606154:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3321:x1875129753697792:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263204.606169:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788263204.606200:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753698048 00000100:00100000:2.0:1788263204.606204:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753698048 00000100:00100000:2.0:1788263204.606256:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753698304 00000100:00100000:2.0:1788263204.606259:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753698304 00000100:00100000:2.0:1788263204.606273:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263204.606279:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753698048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.606313:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753698048:12345-0@lo:400:kworker.0 Request processed in 34us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263204.606320:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263204.606331:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263204.606336:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753698304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.606361:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753698304:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263204.606366:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263204.606383:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753698432 00000100:00100000:2.0:1788263204.606386:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753698432 00000100:00100000:2.0:1788263204.606408:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753698176 00000100:00100000:2.0:1788263204.606411:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753698176 00000100:00100000:2.0:1788263204.606428:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263204.606435:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753698432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.606464:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753698432:12345-0@lo:400:kworker.0 Request processed in 29us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263204.606470:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263204.606481:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263204.606487:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753698176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.606523:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753698176:12345-0@lo:400:kworker.0 Request processed in 36us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263204.606528:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788263204.606569:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943812b1c00 x1875129753698176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263204.607234:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788263204.607244:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753697920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263204.607296:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753697920:12345-0@lo:400:kworker.0 Request processed in 54us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263204.607303:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788263204.607345:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263204.607350:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263204.607352:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263204.607381:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753698048:0@lo:400:kworker.0 00000100:00100000:0.0:1788263204.607505:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753697920:0@lo:400:kworker.0 00010000:00080000:0.0:1788263204.607520:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943812b0a80 x1875129753698432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263204.607530:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753698432:0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.607948:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753698176:0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.607961:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753697792:0@lo:400:kworker.0 00000100:00100000:2.0:1788263204.607972:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753698304:0@lo:400:kworker.0 00010000:00010000:0.0:1788263205.056157:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263205.119136:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263205.119155:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753698560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263205.119232:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.119285:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753698560 00000100:00100000:0.0:1788263205.119291:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753698560 00000100:00100000:0.0:1788263205.119336:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263205.119346:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753698560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263205.119381:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263205.119417:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753698560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.119422:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788263205.119454:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f5500 x1875129753698560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263205.119468:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753698560:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788263205.120828:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263205.120835:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994375782000 from 4 10000000:01000000:0.0:1788263205.120840:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263205.120878:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.120889:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.120901:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263205.120921:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753698688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.120986:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.121021:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.121041:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753698688 00000100:00100000:0.0:1788263205.121046:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753698688 00000100:00100000:0.0:1788263205.121082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788263205.121090:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753698688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263205.121101:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263205.121114:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955b99 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.121136:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955b99 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.121147:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955b99 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.121156:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340031e00, rc 0) 00000100:00100000:0.0:1788263205.121190:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753698688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.121195:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788263205.121251:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753698688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263205.121264:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.121272:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263205.121319:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753698816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.121353:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.121368:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.121381:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753698816 00000100:00100000:0.0:1788263205.121384:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753698816 00000100:00100000:0.0:1788263205.121407:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788263205.121413:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753698816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.121654:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753698816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.121660:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788263205.121691:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753698816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.121719:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753698944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.121760:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.121782:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.121868:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753698944 00000100:00100000:0.0:1788263205.121872:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753698944 00000100:00100000:0.0:1788263205.121896:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788263205.121903:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753698944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.122043:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753698944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.122049:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788263205.122093:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753698944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.122294:0:8601:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8601:1875129753699072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263205.122331:0:8601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.122355:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753699072 00000100:00100000:0.0:1788263205.122365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753699072 00000100:00100000:0.0:1788263205.122390:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788263205.122396:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:8601:x1875129753699072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263205.122543:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:8601:x1875129753699072:12345-0@lo:502:llog_process_th.0 Request processed in 146us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.122550:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788263205.122589:0:8601:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.122603:0:8601:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8601:1875129753699072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263205.122645:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263205.122657:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263205.122659:0:8601:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788263205.122668:0:8601:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994375782000 00000020:00000080:0.0:1788263205.122671:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788263205.122738:0:8601:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8601:1875129753699200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263205.122773:0:8601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.126985:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753699200 00000100:00100000:0.0:1788263205.127000:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753699200 00000100:00100000:0.0:1788263205.127060:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788263205.127069:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:8601:x1875129753699200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263205.127324:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:8601:x1875129753699200:12345-0@lo:502:llog_process_th.0 Request processed in 254us (4549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.127332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788263205.127391:0:8601:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.127415:0:8601:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8601:1875129753699200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263205.127448:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263205.127456:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263205.127463:0:8601:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788263205.127468:0:8601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788263205.127521:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788263205.127539:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263205.127549:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.127560:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263205.127571:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263205.127573:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99438144e800 from 4 10000000:01000000:0.0:1788263205.127576:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263205.127606:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.127614:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.127624:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263205.127645:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753699328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.127682:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.127698:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.127712:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753699328 00000100:00100000:0.0:1788263205.127715:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753699328 00000100:00100000:0.0:1788263205.127739:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788263205.127745:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753699328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263205.127754:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263205.127771:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955ba7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.130037:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955ba7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.130057:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955ba7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.130067:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382042c00, rc 0) 00000100:00100000:0.0:1788263205.130139:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753699328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2392us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.130147:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788263205.132898:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753699328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263205.132927:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.132939:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263205.133017:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753699456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.133078:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.133113:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.133132:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753699456 00000100:00100000:0.0:1788263205.133137:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753699456 00000100:00100000:0.0:1788263205.133181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788263205.133190:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753699456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.139841:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753699456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6641us (6753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.139864:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788263205.140028:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753699456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263205.140077:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753699584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263205.140120:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263205.140154:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943455d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.143977:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753699584 00000100:00100000:0.0:1788263205.143989:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753699584 00000100:00100000:0.0:1788263205.144033:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788263205.144040:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753699584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.144250:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753699584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (4128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.144256:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788263205.144306:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753699584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263205.144549:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8605:1875129753699712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263205.144598:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263205.144634:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce540 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.152297:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753699712 00000100:00100000:0.0:1788263205.152313:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753699712 00000100:00100000:0.0:1788263205.152416:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788263205.152428:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8605:x1875129753699712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263205.152715:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8605:x1875129753699712:12345-0@lo:502:llog_process_th.0 Request processed in 289us (8116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.152724:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788263205.152884:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8605:1875129753699712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788263205.152921:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263205.152932:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263205.152934:0:8605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788263205.152942:0:8605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99438144e800 00000020:00000080:3.0:1788263205.152944:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788263205.153406:0:8605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8605:1875129753699840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263205.153450:0:8605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263205.153613:0:8605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437217cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263205.155110:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753699840 00000100:00100000:2.0:1788263205.155121:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753699840 00000100:00100000:2.0:1788263205.155170:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788263205.155180:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8605:x1875129753699840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263205.155529:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:8605:x1875129753699840:12345-0@lo:502:llog_process_th.0 Request processed in 349us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263205.155538:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788263205.155694:0:8605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8605:1875129753699840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788263205.155873:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263205.155882:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263205.155884:0:8605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788263205.155890:0:8605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788263205.156075:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788263205.156095:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263205.156106:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.156118:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263205.156130:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263205.156134:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994350979800 from 4 10000000:01000000:0.0:1788263205.156137:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263205.156165:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.156180:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.156190:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263205.156210:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753699968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.156346:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.156405:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263205.156439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753699968 00000100:00100000:2.0:1788263205.156444:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753699968 00000100:00100000:2.0:1788263205.156507:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788263205.156517:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753699968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263205.156528:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263205.156541:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955bb5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263205.156563:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955bb5 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263205.156587:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955bb5 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263205.156597:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6c00, rc 0) 00000100:00100000:2.0:1788263205.156644:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753699968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263205.156651:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788263205.156721:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753699968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263205.156734:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263205.156743:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263205.156798:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753700096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263205.156824:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263205.158195:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.158283:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753700096 00000100:00100000:0.0:1788263205.158290:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753700096 00000100:00100000:0.0:1788263205.158330:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788263205.158338:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753700096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.158625:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753700096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.158633:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788263205.158731:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753700096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263205.158774:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753700224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263205.158844:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263205.158884:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.158964:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753700224 00000100:00100000:0.0:1788263205.158970:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753700224 00000100:00100000:0.0:1788263205.158997:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788263205.159004:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753700224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.159149:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753700224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.159155:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788263205.159196:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753700224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263205.159368:0:8608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8608:1875129753700352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263205.159410:0:8608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.159433:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753700352 00000100:00100000:0.0:1788263205.159436:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753700352 00000100:00100000:0.0:1788263205.159459:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788263205.159467:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:8608:x1875129753700352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263205.159594:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:8608:x1875129753700352:12345-0@lo:502:llog_process_th.0 Request processed in 128us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.159602:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788263205.159637:0:8608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.159649:0:8608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8608:1875129753700352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263205.159672:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263205.159683:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263205.159685:0:8608:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788263205.159693:0:8608:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994350979800 00000020:00000080:0.0:1788263205.159695:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788263205.160170:0:8608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8608:1875129753700480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263205.160209:0:8608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.160252:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753700480 00000100:00100000:0.0:1788263205.160256:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753700480 00000100:00100000:0.0:1788263205.160281:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788263205.160288:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:8608:x1875129753700480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263205.160410:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:8608:x1875129753700480:12345-0@lo:502:llog_process_th.0 Request processed in 122us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263205.160417:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788263205.160448:0:8608:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788263205.160462:0:8608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:8608:1875129753700480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263205.160487:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263205.160492:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263205.160493:0:8608:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788263205.160497:0:8608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788263205.160548:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788263205.160567:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263205.160577:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263205.160589:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263205.628028:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263205.628053:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753700608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263205.628126:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263205.629930:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753700608 00000100:00100000:0.0:1788263205.629944:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753700608 00000100:00100000:1.0:1788263205.630117:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263205.630128:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753700608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263205.630168:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263205.630386:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753700608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263205.630393:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788263205.630484:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7b80 x1875129753700608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263205.630508:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753700608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788263206.078471:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263207.105396:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263208.128407:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263208.389947:0:8828:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788263209.147433:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263209.197847:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263209.197978:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735846144 00000100:00100000:2.0:1788263209.197989:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735846144 00000100:00100000:2.0:1788263209.198041:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:2.0:1788263209.198053:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2361:x1875129735846144:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263209.198131:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2361:x1875129735846144:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 80us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263209.198140:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:3.0:1788263209.210679:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263209.210731:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263209.210759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263209.210787:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735846400 00000100:00100000:3.0:1788263209.210797:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735846400 00000100:00100000:3.0:1788263209.210853:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735846528 00000100:00100000:3.0:1788263209.210857:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735846528 00000100:00100000:3.0:1788263209.210878:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788263209.210888:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735846400:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263209.210962:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735846400:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263209.210971:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788263209.210989:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1788263209.210995:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735846528:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263209.211020:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735846528:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263209.211026:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00080000:3.0:1788263209.211042:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263209.211045:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263209.211595:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735846272 00000100:00100000:0.0:1788263209.211601:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735846272 00000100:00100000:0.0:1788263209.211655:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1788263209.211663:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735846272:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263209.211702:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735846272:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 41us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263209.211709:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00080000:3.0:1788263209.211867:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263209.724115:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263209.724209:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753700864:0@lo:400:kworker.0 00000100:00100000:1.0:1788263209.724312:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263209.724372:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263209.724377:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753700992:0@lo:400:kworker.0 00000100:00100000:1.0:1788263209.724398:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263209.724439:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753700864 00000100:00100000:1.0:1788263209.724446:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753700864 00000100:00100000:1.0:1788263209.724486:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753700992 00000100:00100000:1.0:1788263209.724489:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753700992 00000100:00100000:1.0:1788263209.724536:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788263209.724545:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753700864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263209.724596:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753700864:12345-0@lo:400:kworker.0 Request processed in 52us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263209.724603:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788263209.724619:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788263209.724626:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753700992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263209.724667:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753700992:12345-0@lo:400:kworker.0 Request processed in 41us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263209.724673:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788263209.724695:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263209.724745:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753700992:0@lo:400:kworker.0 00000100:00100000:1.0:1788263209.724764:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753700864:0@lo:400:kworker.0 00000100:00100000:1.0:1788263209.725524:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753701376:0@lo:400:kworker.0 00000100:00100000:1.0:1788263209.725556:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263209.725612:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753701120:0@lo:400:kworker.0 00000100:00100000:3.0:1788263209.725652:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263209.725679:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753700736:0@lo:400:kworker.0 00000100:00100000:3.0:1788263209.725713:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263209.725734:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263209.725740:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753701248:0@lo:400:kworker.0 00000100:00100000:3.0:1788263209.725772:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263209.725799:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753701376 00000100:00100000:3.0:1788263209.725803:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753701376 00000100:00100000:3.0:1788263209.725836:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753701120 00000100:00100000:3.0:1788263209.725838:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753701120 00000100:00100000:3.0:1788263209.725858:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788263209.725864:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753701376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263209.726155:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263209.726165:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753701120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263209.726203:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753701120:12345-0@lo:400:kworker.0 Request processed in 41us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263209.726234:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788263209.726255:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263209.726258:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788263209.726266:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753701248 00000100:00100000:0.0:1788263209.726270:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753701248 00000100:00100000:0.0:1788263209.726307:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263209.726313:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753701248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263209.726341:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753701248:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263209.726347:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788263209.726360:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263209.726488:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753700736 00000100:00100000:2.0:1788263209.726495:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753700736 00000100:00100000:2.0:1788263209.726528:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788263209.726543:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753700736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263209.726585:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753700736:12345-0@lo:400:kworker.0 Request processed in 46us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263209.726592:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788263209.726654:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753701248:0@lo:400:kworker.0 00010000:00080000:0.0:1788263209.726667:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f6a00 x1875129753701120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263209.726677:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753701120:0@lo:400:kworker.0 00000100:00100000:0.0:1788263209.726685:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753700736:0@lo:400:kworker.0 00000100:00100000:3.0:1788263209.727863:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753701376:12345-0@lo:400:kworker.0 Request processed in 1994us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263209.727873:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788263209.731508:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f6680 x1875129753701376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263209.731526:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753701376:0@lo:400:kworker.0 00010000:00010000:1.0:1788263210.171451:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263210.235463:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263210.235484:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753701504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263210.235558:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263210.235731:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753701504 00000100:00100000:0.0:1788263210.235739:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753701504 00000100:00100000:0.0:1788263210.235790:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263210.235800:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753701504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263210.235833:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263210.235876:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753701504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263210.235883:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788263210.235970:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7100 x1875129753701504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263210.235986:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753701504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263210.757239:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753701632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263210.757333:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263210.757434:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753701632 00000100:00100000:0.0:1788263210.757443:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753701632 00000100:00100000:0.0:1788263210.757496:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263210.757506:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753701632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263210.757544:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263210.757590:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753701632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263210.757597:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788263210.758860:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f6a00 x1875129753701632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263210.758886:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753701632:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263211.196516:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788263211.635647:0:9071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing yml_node 00010000:00010000:3.0:1788263212.226084:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263213.247305:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263214.267565:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263214.315071:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263214.315132:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263214.315283:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263214.315317:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263214.315442:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735846784 00000100:00100000:0.0:1788263214.315457:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735846784 00000100:00100000:0.0:1788263214.315554:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:0.0:1788263214.315568:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735846784:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263214.315682:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735846784:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 117us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263214.315692:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00080000:0.0:1788263214.315720:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263214.315954:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735846656 00000100:00100000:1.0:1788263214.315959:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735846656 00000100:00100000:1.0:1788263214.316002:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 192 00000100:00100000:1.0:1788263214.316010:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2361:x1875129735846656:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263214.316053:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2361:x1875129735846656:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 43us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263214.316060:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 192 00000100:00100000:2.0:1788263214.321304:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735846912 00000100:00100000:2.0:1788263214.321329:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735846912 00000100:00100000:2.0:1788263214.321534:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735847040 00000100:00100000:2.0:1788263214.321538:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735847040 00000100:00080000:3.0:1788263214.321593:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263214.321599:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263214.322775:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788263214.322799:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735846912:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263214.322954:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735846912:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 166us (7821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263214.322962:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788263214.322998:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788263214.323004:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735847040:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263214.323026:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735847040:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (7710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263214.323030:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788263214.846786:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753701760:0@lo:400:kworker.0 00000100:00100000:0.0:1788263214.846865:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263214.847102:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753701760 00000100:00100000:1.0:1788263214.847111:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753701760 00000100:00100000:1.0:1788263214.847159:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788263214.847168:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753701760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263214.849661:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753702016:0@lo:400:kworker.0 00000100:00100000:2.0:1788263214.849732:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263214.849775:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263214.849782:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753701888:0@lo:400:kworker.0 00000100:00100000:2.0:1788263214.849805:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263214.850085:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753702016 00000100:00100000:0.0:1788263214.850094:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753702016 00000100:00100000:0.0:1788263214.850155:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753701888 00000100:00100000:0.0:1788263214.850158:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753701888 00000100:00100000:0.0:1788263214.850182:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788263214.850191:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753702016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263214.850268:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753702016:12345-0@lo:400:kworker.0 Request processed in 78us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263214.850275:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788263214.850292:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788263214.850303:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753701888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263214.850332:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753701888:12345-0@lo:400:kworker.0 Request processed in 34us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263214.850338:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788263214.850358:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753702144:0@lo:400:kworker.0 00000100:00100000:0.0:1788263214.850733:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263214.850895:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753701888:0@lo:400:kworker.0 00000100:00100000:0.0:1788263214.850906:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753702016:0@lo:400:kworker.0 00000100:00100000:2.0:1788263214.851512:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753702144 00000100:00100000:2.0:1788263214.851520:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753702144 00000100:00080000:3.0:1788263214.851806:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263214.851812:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263214.851965:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263214.852046:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263214.852059:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753702144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263214.852121:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753702144:12345-0@lo:400:kworker.0 Request processed in 66us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263214.852127:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788263214.852736:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753701760:12345-0@lo:400:kworker.0 Request processed in 5565us (5867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263214.852746:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788263214.853209:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753702272:0@lo:400:kworker.0 00000100:00100000:3.0:1788263214.853270:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788263214.853359:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437a588e00 x1875129753702144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263214.853385:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753702144:0@lo:400:kworker.0 00000100:00100000:3.0:1788263214.853444:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263214.853454:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753702400:0@lo:400:kworker.0 00000100:00100000:3.0:1788263214.853483:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263214.853512:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753702400 00000100:00100000:3.0:1788263214.853517:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753702400 00000100:00100000:3.0:1788263214.853575:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263214.853584:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753702400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263214.853636:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753702400:12345-0@lo:400:kworker.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263214.853643:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788263214.853662:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788263214.853683:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437a588e00 x1875129753702400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263214.853691:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753702400:0@lo:400:kworker.0 00000100:00100000:1.0:1788263214.853803:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753702272 00000100:00100000:1.0:1788263214.853808:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753702272 00000100:00100000:1.0:1788263214.853854:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788263214.853861:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753702272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263214.853896:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753702272:12345-0@lo:400:kworker.0 Request processed in 35us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263214.853902:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788263214.854147:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263214.854166:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753702272:0@lo:400:kworker.0 00000100:00100000:0.0:1788263214.857335:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753701760:0@lo:400:kworker.0 00000001:02000400:0.0:1788263215.131403:0:9263:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:1.0:1788263215.295360:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263215.357643:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263215.357709:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753702528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263215.357789:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263215.358505:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753702528 00000100:00100000:0.0:1788263215.358517:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753702528 00000100:00100000:0.0:1788263215.358569:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263215.358579:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753702528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263215.358627:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263215.358696:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753702528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263215.358705:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788263215.358794:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f4a80 x1875129753702528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263215.358954:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753702528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263215.870725:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263215.870749:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753702656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263215.870825:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263215.870886:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753702656 00000100:00100000:0.0:1788263215.870894:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753702656 00000100:00100000:1.0:1788263215.871112:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788263215.871124:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753702656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263215.871170:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263215.871249:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753702656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263215.871256:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788263215.871293:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f4000 x1875129753702656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263215.871312:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753702656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788263216.316050:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263217.339694:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263217.567184:0:9360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:1.0:1788263218.363364:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263219.387573:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263219.441296:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263219.441338:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263219.441546:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735847296 00000100:00100000:3.0:1788263219.441557:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735847296 00000100:00100000:3.0:1788263219.441636:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1788263219.441648:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735847296:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263219.441738:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735847296:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 92us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263219.441763:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00080000:1.0:1788263219.441951:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263219.443083:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735847168 00000100:00100000:2.0:1788263219.443094:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735847168 00000100:00100000:2.0:1788263219.443154:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:2.0:1788263219.443163:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2359:x1875129735847168:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263219.443269:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2359:x1875129735847168:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 107us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263219.443288:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:1.0:1788263219.445793:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263219.445837:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263219.446121:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735847424 00000100:00100000:3.0:1788263219.446132:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735847424 00000100:00100000:3.0:1788263219.446202:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735847552 00000100:00100000:3.0:1788263219.446206:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735847552 00000100:00100000:3.0:1788263219.446270:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263219.446283:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+5:2358:x1875129735847424:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1788263219.446326:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955af8 00000100:00080000:3.0:1788263219.446336:0:6705:0:(import.c:65:import_set_state_nolock()) ffff99437cb23800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788263219.446372:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788263219.446547:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788263219.446557:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263219.446561:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263219.446590:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:1.0:1788263219.446599:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2358:x1875129735847552:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:1.0:1788263219.446619:0:8112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955aff 00000100:00080000:1.0:1788263219.446626:0:8112:0:(import.c:65:import_set_state_nolock()) ffff99437cb27000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263219.446651:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788263219.447008:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+2:2358:x1875129735847552:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 409us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263219.447016:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00010000:00010000:1.0:1788263219.447062:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263219.447618:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+2:2358:x1875129735847424:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 1335us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263219.447626:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263219.968722:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753703040:0@lo:400:kworker.0 00000100:00100000:2.0:1788263219.968817:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753702912:0@lo:400:kworker.0 00000100:00100000:3.0:1788263219.968820:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263219.968866:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263219.968901:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753703424:0@lo:400:kworker.0 00000100:00100000:2.0:1788263219.968929:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263219.969121:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753703040 00000100:00100000:0.0:1788263219.969132:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753703040 00000100:00100000:0.0:1788263219.969197:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753702912 00000100:00100000:0.0:1788263219.969200:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753702912 00000100:00100000:0.0:1788263219.969244:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263219.969256:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753703040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263219.969328:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753703040:12345-0@lo:400:kworker.0 Request processed in 73us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263219.969337:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263219.969357:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263219.969363:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753702912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263219.969419:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753702912:12345-0@lo:400:kworker.0 Request processed in 56us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263219.969499:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753702784:0@lo:400:kworker.0 00000100:00100000:1.0:1788263219.969552:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263219.969578:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753703296:0@lo:400:kworker.0 00000100:00100000:1.0:1788263219.969603:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263219.969617:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263219.969623:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753703168:0@lo:400:kworker.0 00000100:00100000:1.0:1788263219.969646:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263219.969680:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753703296 00000100:00100000:1.0:1788263219.969684:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753703296 00000100:00100000:3.0:1788263219.969897:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753703424 00000100:00100000:3.0:1788263219.969902:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753703424 00000100:00100000:3.0:1788263219.970149:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753703168 00000100:00100000:3.0:1788263219.970154:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753703168 00000100:00100000:3.0:1788263219.970179:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263219.970187:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753703424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263219.970254:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753703424:12345-0@lo:400:kworker.0 Request processed in 68us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263219.970261:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263219.970279:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263219.970286:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753703168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263219.970334:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753703168:12345-0@lo:400:kworker.0 Request processed in 48us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263219.970340:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263219.970745:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788263219.970769:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263219.970774:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263219.970777:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263219.970822:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753703040:0@lo:400:kworker.0 00000100:00100000:0.0:1788263219.970857:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753702912:0@lo:400:kworker.0 00010000:00080000:0.0:1788263219.970871:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7800 x1875129753703424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263219.970882:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753703424:0@lo:400:kworker.0 00000100:00100000:0.0:1788263219.972641:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753702784 00000100:00100000:0.0:1788263219.972660:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753702784 00000100:00100000:0.0:1788263219.972753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788263219.972766:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753702784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263219.972873:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753702784:12345-0@lo:400:kworker.0 Request processed in 108us (3319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263219.972881:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788263219.977691:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788263219.977718:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753703296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263219.977857:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753703296:12345-0@lo:400:kworker.0 Request processed in 150us (8252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263219.977867:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788263219.977953:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7100 x1875129753703168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263219.977972:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753703168:0@lo:400:kworker.0 00000100:00100000:1.0:1788263219.977989:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753702784:0@lo:400:kworker.0 00000100:00100000:1.0:1788263219.978002:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753703296:0@lo:400:kworker.0 00010000:00010000:1.0:1788263220.412493:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788263220.437264:0:9458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00000100:00100000:0.0:1788263220.481257:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263220.481288:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753703552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263220.481380:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263220.481484:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753703552 00000100:00100000:0.0:1788263220.481494:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753703552 00000100:00100000:0.0:1788263220.481571:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788263220.481584:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753703552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263220.481647:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263220.481705:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753703552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263220.481713:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788263220.481766:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7800 x1875129753703552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263220.481788:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753703552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263220.988554:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753703680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263220.988669:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263220.990612:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753703680 00000100:00100000:0.0:1788263220.990635:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753703680 00000100:00100000:0.0:1788263220.990746:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788263220.990759:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753703680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263220.990813:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263220.990922:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753703680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263220.990931:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788263220.991279:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7800 x1875129753703680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263220.991330:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753703680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263221.436759:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788263221.579694:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:0.0:1788263221.579704:0:6729:0:(genops.c:885:class_export_put()) final put ffff9942421ac000/fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:2.0:1788263221.579852:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff9942421ac000/fedef325-db54-4469-b29a-301ff58466df for lustre-OST0000 00000020:00000080:2.0:1788263221.579916:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99437cb23800 for lustre-OST0000 00000001:02000400:0.0:1788263222.447180:0:9507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 1 07:47:00 EDT 2026 00010000:00010000:1.0:1788263222.464699:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263223.484850:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788263223.592695:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:0.0:1788263223.592708:0:7662:0:(genops.c:885:class_export_put()) final put ffff99437cb24000/fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:0.0:1788263223.592879:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff99437cb24000/fedef325-db54-4469-b29a-301ff58466df for lustre-OST0001 00000020:00000080:0.0:1788263223.594293:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99437cb27000 for lustre-OST0001 00010000:00010000:1.0:1788263224.508872:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263224.551833:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263224.551919:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263224.552044:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735847808 00000100:00100000:3.0:1788263224.552057:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735847808 00000100:00100000:2.0:1788263224.552125:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735847680 00000100:00100000:2.0:1788263224.552130:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735847680 00000100:00100000:2.0:1788263224.552179:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:2.0:1788263224.552188:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2362:x1875129735847680:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263224.552210:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1788263224.552233:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735847808:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263224.552289:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2362:x1875129735847680:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 100us (368us total) trans 0 rc 0/0 00000100:00080000:1.0:1788263224.552293:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263224.552296:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:3.0:1788263224.552334:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735847808:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 118us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263224.552341:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1788263225.084405:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753703936:0@lo:400:kworker.0 00000100:00100000:0.0:1788263225.084488:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263225.084539:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753704448:0@lo:400:kworker.0 00000100:00100000:0.0:1788263225.084574:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263225.084607:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263225.084613:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753704064:0@lo:400:kworker.0 00000100:00100000:0.0:1788263225.084634:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263225.084668:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753704448 00000100:00100000:0.0:1788263225.084675:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753704448 00000100:00100000:0.0:1788263225.084731:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263225.084741:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753704448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263225.084792:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753704448:12345-0@lo:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263225.084800:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788263225.084842:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f4700 x1875129753704448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263225.084858:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753704448:0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085010:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753704192:0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085057:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263225.085091:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788263225.085098:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753703808:0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085126:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263225.085150:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753704320:0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085173:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263225.085203:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753703936 00000100:00100000:1.0:1788263225.085208:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753703936 00000100:00100000:1.0:1788263225.085256:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753704064 00000100:00100000:1.0:1788263225.085260:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753704064 00000100:00100000:1.0:1788263225.085273:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753704320 00000100:00100000:1.0:1788263225.085276:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753704320 00000100:00100000:1.0:1788263225.085290:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788263225.085297:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753703936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085350:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753703936:12345-0@lo:400:kworker.0 Request processed in 41us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263225.085358:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788263225.085371:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788263225.085385:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753704064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085416:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753704064:12345-0@lo:400:kworker.0 Request processed in 33us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263225.085422:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788263225.085435:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788263225.085455:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753704320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085488:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753704320:12345-0@lo:400:kworker.0 Request processed in 35us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263225.085494:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788263225.085514:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263225.085519:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263225.085530:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753703808 00000100:00100000:1.0:1788263225.085534:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753703808 00000100:00100000:1.0:1788263225.085557:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788263225.085564:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753703808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085592:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753703808:12345-0@lo:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263225.085598:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788263225.085641:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753703808:0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085654:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753704320:0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085679:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753704064:0@lo:400:kworker.0 00000100:00100000:1.0:1788263225.085688:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753703936:0@lo:400:kworker.0 00000100:00100000:0.0:1788263225.087265:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753704192 00000100:00100000:0.0:1788263225.087279:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753704192 00000100:00100000:0.0:1788263225.087327:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263225.087337:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753704192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263225.087410:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753704192:12345-0@lo:400:kworker.0 Request processed in 75us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263225.087418:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788263225.087629:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788263225.087664:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7480 x1875129753704192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263225.087693:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753704192:0@lo:400:kworker.0 00010000:00010000:3.0:1788263225.534088:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263225.596258:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263225.596285:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753704576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263225.596438:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263225.596555:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753704576 00000100:00100000:0.0:1788263225.596562:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753704576 00000100:00100000:0.0:1788263225.596601:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788263225.596608:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753704576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263225.596639:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263225.596693:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753704576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263225.596701:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788263225.596955:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f4700 x1875129753704576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263225.596995:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753704576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263226.112780:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753704704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263226.112855:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263226.112932:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753704704 00000100:00100000:0.0:1788263226.112939:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753704704 00000100:00100000:0.0:1788263226.112987:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263226.112997:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753704704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263226.113033:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263226.113086:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753704704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263226.113094:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788263226.113134:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f6d80 x1875129753704704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263226.113151:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753704704:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263226.557778:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263227.580788:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263228.603894:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263229.628955:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263229.676321:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263229.676380:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263229.676414:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735847936 00000100:00100000:1.0:1788263229.677971:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735847936 00000100:00100000:1.0:1788263229.678085:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 198 00000100:00100000:1.0:1788263229.678098:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2362:x1875129735847936:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263229.678195:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2362:x1875129735847936:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 99us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263229.678204:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 198 00000100:00100000:3.0:1788263229.688141:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735848064 00000100:00100000:3.0:1788263229.688161:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735848064 00000100:00100000:3.0:1788263229.688370:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:3.0:1788263229.688382:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735848064:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263229.688993:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735848064:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 610us (12679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.689004:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00080000:0.0:1788263229.690979:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263230.203423:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263230.203449:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753704832:0@lo:400:kworker.0 00000100:00100000:3.0:1788263230.203542:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263230.203602:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753705216:0@lo:400:kworker.0 00000100:00100000:3.0:1788263230.203632:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263230.203634:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753705344:0@lo:400:kworker.0 00000100:00100000:3.0:1788263230.203665:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753705088:0@lo:400:kworker.0 00000100:00100000:2.0:1788263230.203667:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263230.203704:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263230.203704:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753705344 00000100:00100000:2.0:1788263230.203712:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753705344 00000100:00100000:3.0:1788263230.203723:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788263230.203728:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753704960:0@lo:400:kworker.0 00000100:00100000:3.0:1788263230.203748:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263230.203763:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753705472:0@lo:400:kworker.0 00000100:00100000:2.0:1788263230.203766:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753705088 00000100:00100000:2.0:1788263230.203769:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753705088 00000100:00100000:3.0:1788263230.203785:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263230.203811:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753705216 00000100:00100000:3.0:1788263230.203815:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753705216 00000100:00100000:2.0:1788263230.203870:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753704960 00000100:00100000:2.0:1788263230.203874:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753704960 00000100:00100000:2.0:1788263230.203891:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788263230.203901:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753705344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263230.203959:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753705344:12345-0@lo:400:kworker.0 Request processed in 59us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263230.204079:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753705472 00000100:00100000:3.0:1788263230.204084:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753705472 00000100:00100000:3.0:1788263230.204110:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788263230.204117:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753705216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263230.204155:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753705216:12345-0@lo:400:kworker.0 Request processed in 39us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263230.204163:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788263230.204181:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263230.204188:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753705472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263230.204236:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753705472:12345-0@lo:400:kworker.0 Request processed in 49us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263230.204242:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263230.204336:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263230.204396:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753704832 00000100:00100000:0.0:1788263230.204401:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753704832 00000100:00100000:0.0:1788263230.204441:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788263230.204448:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753704832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263230.204482:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753704832:12345-0@lo:400:kworker.0 Request processed in 34us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263230.204486:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788263230.204487:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788263230.204494:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753705088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263230.204525:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753705088:12345-0@lo:400:kworker.0 Request processed in 32us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263230.204531:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788263230.204545:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788263230.204559:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753704960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263230.204587:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753704960:12345-0@lo:400:kworker.0 Request processed in 30us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263230.204593:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788263230.204600:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263230.204604:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263230.204606:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263230.204635:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753704960:0@lo:400:kworker.0 00000100:00100000:2.0:1788263230.206720:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753705344:0@lo:400:kworker.0 00010000:00080000:2.0:1788263230.208546:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f5880 x1875129753705216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263230.208563:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753705216:0@lo:400:kworker.0 00000100:00100000:2.0:1788263230.208577:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753704832:0@lo:400:kworker.0 00010000:00080000:3.0:1788263230.209020:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f5500 x1875129753705472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263230.209033:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753705472:0@lo:400:kworker.0 00000100:00100000:2.0:1788263230.209126:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753705088:0@lo:400:kworker.0 00010000:00010000:1.0:1788263230.651455:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263230.715641:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753705600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263230.715718:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263230.717779:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753705600 00000100:00100000:0.0:1788263230.717809:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753705600 00000100:00100000:0.0:1788263230.718713:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263230.718726:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753705600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263230.718765:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263230.718854:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753705600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (3135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263230.718861:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788263230.721349:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f4a80 x1875129753705600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263230.721375:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753705600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263231.237553:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263231.237590:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753705728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263231.237664:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263231.238615:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753705728 00000100:00100000:3.0:1788263231.238626:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753705728 00000100:00100000:3.0:1788263231.238674:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788263231.238683:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753705728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263231.238727:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263231.240241:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753705728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1521us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263231.240254:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788263231.251491:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437a589c00 x1875129753705728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263231.251522:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753705728:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263231.675924:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263232.701629:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263233.724396:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263234.750511:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263234.790210:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263234.790482:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263234.790512:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735848192 00000100:00100000:0.0:1788263234.790522:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735848192 00000100:00100000:0.0:1788263234.790573:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:0.0:1788263234.790601:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2359:x1875129735848192:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263234.790680:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2359:x1875129735848192:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 97us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263234.790688:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:0.0:1788263234.790725:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735848320 00000100:00100000:0.0:1788263234.790729:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735848320 00000100:00100000:0.0:1788263234.790771:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:0.0:1788263234.790778:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735848320:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263234.790810:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735848320:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263234.790830:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00080000:0.0:1788263234.790951:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263235.323575:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753706240:0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.323678:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263235.323747:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788263235.323755:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753705856:0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.323786:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263235.323811:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753706368:0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.323839:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263235.323870:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753705984:0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.323896:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263235.323918:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753706496:0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.323941:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263235.323961:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263235.323967:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753706112:0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.323989:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263235.324022:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753706240 00000100:00100000:0.0:1788263235.324030:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753706240 00000100:00100000:0.0:1788263235.324086:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753706496 00000100:00100000:0.0:1788263235.324089:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753706496 00000100:00100000:0.0:1788263235.324117:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263235.324127:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753706240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.324187:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753706240:12345-0@lo:400:kworker.0 Request processed in 61us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263235.324195:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263235.324254:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263235.324272:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753706496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.324308:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753706496:12345-0@lo:400:kworker.0 Request processed in 48us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263235.324314:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263235.324334:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753705856 00000100:00100000:0.0:1788263235.324338:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753705856 00000100:00100000:0.0:1788263235.324363:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788263235.324369:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753705856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.324399:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753705856:12345-0@lo:400:kworker.0 Request processed in 31us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263235.324405:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788263235.324431:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753706368 00000100:00100000:0.0:1788263235.324435:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753706368 00000100:00100000:0.0:1788263235.324462:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753705984 00000100:00100000:0.0:1788263235.324465:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753705984 00000100:00100000:0.0:1788263235.324476:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753706112 00000100:00100000:0.0:1788263235.324478:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753706112 00000100:00100000:0.0:1788263235.324493:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788263235.324500:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753706368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.324531:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753706368:12345-0@lo:400:kworker.0 Request processed in 32us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263235.324538:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788263235.324549:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263235.324555:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753705984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.324581:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753705984:12345-0@lo:400:kworker.0 Request processed in 27us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263235.324597:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263235.324609:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788263235.324616:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753706112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.324646:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753706112:12345-0@lo:400:kworker.0 Request processed in 31us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263235.324651:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788263235.324675:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263235.324681:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263235.324683:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263235.324730:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753706112:0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.324743:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753705984:0@lo:400:kworker.0 00010000:00080000:0.0:1788263235.324757:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7b80 x1875129753706496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263235.324768:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753706496:0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.324803:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753705856:0@lo:400:kworker.0 00000100:00100000:0.0:1788263235.324813:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753706368:0@lo:400:kworker.0 00010000:00080000:0.0:1788263235.324825:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f6d80 x1875129753706240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263235.324835:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753706240:0@lo:400:kworker.0 00010000:00010000:1.0:1788263235.771425:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263235.841820:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753706624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263235.841905:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263235.842384:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753706624 00000100:00100000:0.0:1788263235.842395:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753706624 00000100:00100000:0.0:1788263235.842470:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263235.842480:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753706624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263235.842526:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263235.842581:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753706624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263235.842590:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788263235.843673:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f6d80 x1875129753706624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263235.843694:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753706624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263236.347570:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753706752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263236.347657:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263236.347792:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753706752 00000100:00100000:3.0:1788263236.347803:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753706752 00000100:00100000:3.0:1788263236.347870:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263236.347882:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753706752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263236.347926:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263236.347987:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753706752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263236.347996:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788263236.348060:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437a58ad80 x1875129753706752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263236.348083:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753706752:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263236.803843:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263237.337879:0:10141:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:47:15 (1788263235) === 00000100:00100000:3.0:1788263237.764651:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263237.764985:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735848448 00000100:00100000:0.0:1788263237.764995:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735848448 00000100:00100000:0.0:1788263237.765059:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:0.0:1788263237.765070:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:8124:x1875129735848448:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788263237.765087:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263237.765104:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994382042000/0x1a657bc513955bc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2f71 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263237.765136:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994382042000/0x1a657bc513955bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f71 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263237.765148:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994382042000/0x1a657bc513955bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f71 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263237.765158:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382042000, rc 0) 00000100:00100000:0.0:1788263237.765255:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8124:x1875129735848448:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 186us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.765263:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:0.0:1788263237.769563:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263237.771019:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735848576 00000100:00100000:2.0:1788263237.771033:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735848576 00000100:00100000:2.0:1788263237.771110:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 203 00000100:00100000:2.0:1788263237.771121:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8124:x1875129735848576:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788263237.772771:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8124:x1875129735848576:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 1645us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263237.772782:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 203 00000100:00100000:1.0:1788263237.786642:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263237.786821:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735848704 00000100:00100000:0.0:1788263237.786834:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735848704 00000100:00100000:0.0:1788263237.786895:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:0.0:1788263237.786906:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8124:x1875129735848704:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788263237.787144:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8124:x1875129735848704:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 239us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.787165:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:0.0:1788263237.791012:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263237.791330:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735848832 00000100:00100000:1.0:1788263237.791340:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735848832 00000100:00100000:1.0:1788263237.791391:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 205 00000100:00100000:1.0:1788263237.791402:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8128:x1875129735848832:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263237.791661:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8128:x1875129735848832:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 260us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263237.791669:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 205 00000100:00100000:1.0:1788263237.808889:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263237.808953:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735848960 00000100:00100000:2.0:1788263237.808964:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735848960 00000100:00100000:2.0:1788263237.809079:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:2.0:1788263237.809091:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8128:x1875129735848960:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263237.809432:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8128:x1875129735848960:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 343us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263237.809441:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:2.0:1788263237.818436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263237.818487:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735849088 00000100:00100000:0.0:1788263237.818496:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735849088 00000100:00100000:0.0:1788263237.818576:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 207 00000100:00100000:0.0:1788263237.818585:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:8124:x1875129735849088:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788263237.818599:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263237.818613:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994382043400/0x1a657bc513955bca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2f9b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263237.818634:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994382043400/0x1a657bc513955bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f9b expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263237.818641:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994382043400/0x1a657bc513955bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f9b expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263237.818649:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382043400, rc 0) 00000100:00100000:0.0:1788263237.818701:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:8124:x1875129735849088:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 118us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.818706:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 207 00010000:00010000:1.0:1788263237.819635:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263237.820677:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263237.820733:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735849216 00000100:00100000:2.0:1788263237.820742:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735849216 00000100:00100000:2.0:1788263237.820970:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 208 00000100:00100000:2.0:1788263237.820982:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:8124:x1875129735849216:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788263237.821006:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788263237.821029:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788263237.821033:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788263237.821036:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788263237.821038:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788263237.823603:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:8124:x1875129735849216:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 2610us (2915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.823618:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 208 00000100:00100000:0.0:1788263237.827531:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263237.827625:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735849344 00000100:00100000:2.0:1788263237.827635:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735849344 00000100:00100000:2.0:1788263237.827681:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 209 00000100:00100000:2.0:1788263237.827691:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:8124:x1875129735849344:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788263237.827707:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263237.827725:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2fa2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263237.827752:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fa2 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263237.827764:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fa2 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263237.827802:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6a00, rc 0) 00000100:00100000:2.0:1788263237.827880:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:8124:x1875129735849344:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 190us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263237.827887:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 209 00000100:00100000:0.0:1788263237.831051:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263237.831142:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735849472 00000100:00100000:3.0:1788263237.831151:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735849472 00000100:00100000:3.0:1788263237.831210:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:3.0:1788263237.831256:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:8124:x1875129735849472:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788263237.832156:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:8124:x1875129735849472:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 934us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.832165:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:3.0:1788263237.834285:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263237.834368:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735849600 00000100:00100000:0.0:1788263237.834389:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735849600 00000100:00100000:0.0:1788263237.834443:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:0.0:1788263237.834562:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:8124:x1875129735849600:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788263237.834810:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:8124:x1875129735849600:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 251us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.834818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:0.0:1788263237.841281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263237.841472:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735849728 00000100:00100000:1.0:1788263237.841482:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735849728 00000100:00100000:1.0:1788263237.841546:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:1.0:1788263237.841557:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:8132:x1875129735849728:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263237.841827:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:8132:x1875129735849728:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 271us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263237.841836:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:2.0:1788263237.845346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263237.845684:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735849856 00000100:00100000:3.0:1788263237.845694:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735849856 00000100:00100000:3.0:1788263237.845757:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:3.0:1788263237.845766:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:8132:x1875129735849856:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263237.846034:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:8132:x1875129735849856:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 267us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.846043:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:3.0:1788263237.850513:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263237.851485:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735850368 00000100:00100000:0.0:1788263237.851499:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735850368 00000100:00080000:2.0:1788263237.851718:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263237.853356:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:0.0:1788263237.853381:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735850368:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263237.853485:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735850368:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 115us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.853492:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:2.0:1788263237.861162:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263237.871493:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735849984 00000100:00100000:1.0:1788263237.871508:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735849984 00000100:00100000:2.0:1788263237.872112:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263237.872387:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2358:x1875129735849984:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788263237.872425:0:6725:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 584ba373-7851-453b-ba8f-f510758f1581@192.168.201.29@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1788263237.872470:0:6725:0:(genops.c:1385:class_connect()) connect: client 584ba373-7851-453b-ba8f-f510758f1581, cookie 0x1a657bc513955bd8 00000004:00100000:2.0:1788263237.872502:0:6725:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788263237.872868:0:6725:0:(import.c:65:import_set_state_nolock()) ffff99437cb20800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263237.872948:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+6:2358:x1875129735849984:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 562us (11794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263237.872957:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263237.876409:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263237.876444:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263237.876507:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735850240 00000100:00100000:3.0:1788263237.876518:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735850240 00000100:00100000:3.0:1788263237.876589:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735850112 00000100:00100000:3.0:1788263237.876592:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735850112 00000100:00100000:3.0:1788263237.876620:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788263237.876631:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+7:8124:x1875129735850240:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788263237.876673:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788263237.876674:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263237.876704:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788263237.876712:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+7:0:x1875129735850112:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788263237.876725:0:6725:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788263237.876817:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+7:0:x1875129735850112:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 103us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263237.876841:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1788263237.877074:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+6:8124:x1875129735850240:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 444us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.877089:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788263237.879642:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263237.879720:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735850496 00000100:00100000:1.0:1788263237.879728:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735850496 00000100:00100000:1.0:1788263237.879802:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788263237.879813:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+6:8124:x1875129735850496:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788263237.879909:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+6:8124:x1875129735850496:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 93us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263237.879916:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1788263237.882488:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263237.882532:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263237.882757:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735850624 00000100:00100000:3.0:1788263237.882767:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735850624 00000100:00100000:0.0:1788263237.882835:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735850752 00000100:00100000:0.0:1788263237.882840:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735850752 00000100:00100000:0.0:1788263237.882888:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788263237.882896:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875129735850752:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788263237.882929:0:8112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 584ba373-7851-453b-ba8f-f510758f1581@192.168.201.29@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1788263237.882982:0:8112:0:(genops.c:1385:class_connect()) connect: client 584ba373-7851-453b-ba8f-f510758f1581, cookie 0x1a657bc513955bdf 00002000:00100000:0.0:1788263237.882997:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 584ba373-7851-453b-ba8f-f510758f1581/ffff99437a6b4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788263237.883023:0:8112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788263237.883428:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788263237.883433:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875129735850624:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788263237.883446:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 584ba373-7851-453b-ba8f-f510758f1581@192.168.201.29@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1788263237.883460:0:6705:0:(genops.c:1385:class_connect()) connect: client 584ba373-7851-453b-ba8f-f510758f1581, cookie 0x1a657bc513955be6 00002000:00100000:3.0:1788263237.883464:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 584ba373-7851-453b-ba8f-f510758f1581/ffff99434647c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788263237.883469:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788263237.883567:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788263237.883594:0:6705:0:(import.c:65:import_set_state_nolock()) ffff99434647a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263237.883650:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:584ba373-7851-453b-ba8f-f510758f1581+6:2358:x1875129735850624:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 216us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.883656:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00002000:00080000:0.0:1788263237.883713:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788263237.883724:0:8112:0:(import.c:65:import_set_state_nolock()) ffff99437a6b2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263237.883742:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+6:2358:x1875129735850752:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 847us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.883747:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788263237.883790:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263237.883949:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735850880 00000100:00100000:3.0:1788263237.883955:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735850880 00000100:00100000:3.0:1788263237.884042:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1788263237.884051:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:584ba373-7851-453b-ba8f-f510758f1581+6:8124:x1875129735850880:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788263237.884116:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788263237.884164:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:584ba373-7851-453b-ba8f-f510758f1581+6:8124:x1875129735850880:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 113us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.884170:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00010000:00010000:0.0:1788263238.845825:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788263238.996005:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 584ba373-7851-453b-ba8f-f510758f1581 00000001:00100000:0.0:1788263239.008950:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 584ba373-7851-453b-ba8f-f510758f1581 00010000:00010000:1.0:1788263239.867410:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263240.460456:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753706880:0@lo:400:kworker.0 00000100:00100000:0.0:1788263240.460555:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263240.462903:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753707136:0@lo:400:kworker.0 00000100:00100000:2.0:1788263240.462995:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263240.463048:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263240.463057:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753707008:0@lo:400:kworker.0 00000100:00100000:2.0:1788263240.463084:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263240.463123:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753707264:0@lo:400:kworker.0 00000100:00100000:2.0:1788263240.463155:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263240.463258:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753707136 00000100:00100000:2.0:1788263240.463267:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753707136 00000100:00100000:2.0:1788263240.463335:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753707008 00000100:00100000:2.0:1788263240.463339:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753707008 00000100:00100000:2.0:1788263240.463377:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263240.463388:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753707136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263240.463456:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753707136:12345-0@lo:400:kworker.0 Request processed in 69us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263240.463464:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263240.463482:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788263240.463487:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753707008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263240.463510:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753707008:12345-0@lo:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263240.463515:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788263240.463544:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263240.463581:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753707008:0@lo:400:kworker.0 00000100:00100000:2.0:1788263240.463591:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753707136:0@lo:400:kworker.0 00000100:00100000:0.0:1788263240.464790:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753706880 00000100:00100000:0.0:1788263240.464803:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753706880 00000100:00100000:0.0:1788263240.464845:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788263240.464853:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753706880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263240.464922:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753706880:12345-0@lo:400:kworker.0 Request processed in 71us (4368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263240.464929:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788263240.464991:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753706880:0@lo:400:kworker.0 00000100:00100000:1.0:1788263240.469078:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263240.469105:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753707392:0@lo:400:kworker.0 00000100:00100000:1.0:1788263240.469211:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263240.469305:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753707392 00000100:00100000:3.0:1788263240.469309:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753707264 00000100:00100000:1.0:1788263240.469313:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753707392 00000100:00100000:3.0:1788263240.469324:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753707264 00000100:00100000:1.0:1788263240.469377:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788263240.469385:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753707392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263240.469404:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788263240.469437:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753707264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263240.469447:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753707392:12345-0@lo:400:kworker.0 Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263240.469458:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788263240.469488:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263240.469496:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263240.469534:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753707264:12345-0@lo:400:kworker.0 Request processed in 100us (6374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263240.469542:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753707392:0@lo:400:kworker.0 00000100:00100000:3.0:1788263240.469548:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788263240.469597:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437a589f80 x1875129753707264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263240.469612:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753707264:0@lo:400:kworker.0 00000100:00100000:3.0:1788263240.469620:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753707520:0@lo:400:kworker.0 00000100:00100000:3.0:1788263240.469663:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263240.469808:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753707520 00000100:00100000:1.0:1788263240.469813:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753707520 00000100:00100000:1.0:1788263240.469863:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263240.469871:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753707520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263240.469910:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753707520:12345-0@lo:400:kworker.0 Request processed in 40us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263240.469917:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788263240.469961:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788263240.470017:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437a588a80 x1875129753707520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263240.470030:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753707520:0@lo:400:kworker.0 00010000:00010000:0.0:1788263240.891380:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263240.956453:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263240.956476:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753707648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263240.956542:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263240.956687:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753707648 00000100:00100000:0.0:1788263240.956704:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753707648 00000100:00100000:0.0:1788263240.956754:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263240.956763:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753707648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263240.956796:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263240.956837:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753707648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263240.956844:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788263240.956879:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7480 x1875129753707648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263240.956896:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753707648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263241.468373:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263241.468400:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753707776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263241.468474:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263241.468925:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753707776 00000100:00100000:3.0:1788263241.468934:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753707776 00000100:00100000:3.0:1788263241.468989:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788263241.468999:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753707776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263241.469033:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263241.469093:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753707776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263241.469101:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788263241.469162:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437a588a80 x1875129753707776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263241.469181:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753707776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263241.915966:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788263242.054338:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 584ba373-7851-453b-ba8f-f510758f1581 00010000:00010000:0.0:1788263242.939469:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263242.991452:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263242.991491:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263242.991528:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263242.991549:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263242.991571:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263242.991613:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735851520 00000100:00100000:3.0:1788263242.991621:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735851520 00000100:00100000:3.0:1788263242.991676:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735851392 00000100:00100000:3.0:1788263242.991680:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735851392 00000100:00100000:3.0:1788263242.991705:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:3.0:1788263242.991715:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735851520:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263242.991786:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735851520:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 71us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263242.991794:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:3.0:1788263242.991815:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:3.0:1788263242.991821:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735851392:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263242.991846:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735851392:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263242.991853:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00080000:3.0:1788263242.991875:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263242.991878:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263242.991946:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735851264 00000100:00100000:2.0:1788263242.991951:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735851264 00000100:00100000:2.0:1788263242.992005:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735851136 00000100:00100000:2.0:1788263242.992008:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735851136 00000100:00100000:2.0:1788263242.992028:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1788263242.992035:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735851264:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263242.992078:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735851264:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 43us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263242.992085:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1788263242.992098:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1788263242.992105:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735851136:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263242.992137:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735851136:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263242.992143:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1788263242.992481:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735851008 00000100:00100000:1.0:1788263242.992485:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735851008 00000100:00100000:1.0:1788263242.992514:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:1.0:1788263242.992520:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735851008:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263242.992551:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735851008:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.992558:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00080000:3.0:1788263242.992706:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788263243.604935:0:10337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788263243.963506:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263244.994154:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263245.564147:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263245.564171:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753707904:0@lo:400:kworker.0 00000100:00100000:1.0:1788263245.564269:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263245.564377:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753708288:0@lo:400:kworker.0 00000100:00100000:1.0:1788263245.564406:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263245.564450:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263245.564456:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753708416:0@lo:400:kworker.0 00000100:00100000:1.0:1788263245.564480:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263245.564719:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753708160:0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.564765:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263245.564789:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788263245.564795:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753708032:0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.564827:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263245.564845:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753708544:0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.564866:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263245.564896:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753708416 00000100:00100000:2.0:1788263245.564904:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753708416 00000100:00100000:2.0:1788263245.564957:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753708160 00000100:00100000:2.0:1788263245.564961:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753708160 00000100:00100000:2.0:1788263245.564973:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753708032 00000100:00100000:2.0:1788263245.564976:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753708032 00000100:00100000:2.0:1788263245.564989:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263245.565144:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753708416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.565204:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753708416:12345-0@lo:400:kworker.0 Request processed in 64us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263245.565213:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263245.565250:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788263245.565258:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753708160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.565290:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753708160:12345-0@lo:400:kworker.0 Request processed in 33us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263245.565296:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788263245.565308:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788263245.565314:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753708032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.565339:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753708032:12345-0@lo:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263245.565345:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788263245.565368:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753708288 00000100:00100000:2.0:1788263245.565372:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753708288 00000100:00100000:2.0:1788263245.565398:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753708544 00000100:00100000:2.0:1788263245.565408:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753708544 00000100:00100000:2.0:1788263245.565435:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263245.565440:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753708288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.565471:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753708288:12345-0@lo:400:kworker.0 Request processed in 31us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263245.565478:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263245.565489:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263245.565495:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753708544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.565521:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753708544:12345-0@lo:400:kworker.0 Request processed in 26us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263245.565527:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788263245.565543:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263245.565547:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263245.565549:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263245.565580:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753708032:0@lo:400:kworker.0 00010000:00080000:2.0:1788263245.565594:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437f6e8000 x1875129753708544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263245.565603:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753708544:0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.565613:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753708160:0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.565670:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753707904 00000100:00100000:2.0:1788263245.565674:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753707904 00000100:00100000:2.0:1788263245.565702:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788263245.565708:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753707904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263245.565738:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753707904:12345-0@lo:400:kworker.0 Request processed in 31us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263245.565753:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788263245.568342:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753708416:0@lo:400:kworker.0 00010000:00080000:1.0:1788263245.568366:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437f6eaa00 x1875129753708288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263245.568378:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753708288:0@lo:400:kworker.0 00000100:00100000:1.0:1788263245.568389:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753707904:0@lo:400:kworker.0 00010000:00010000:1.0:1788263246.030352:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263246.076357:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263246.076381:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753708672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263246.076457:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263246.076532:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753708672 00000100:00100000:0.0:1788263246.076540:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753708672 00000100:00100000:0.0:1788263246.076590:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263246.076600:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753708672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263246.076640:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263246.076690:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753708672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263246.076697:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788263246.076741:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7480 x1875129753708672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263246.076758:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753708672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263246.587788:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753708800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263246.587892:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263246.588321:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753708800 00000100:00100000:0.0:1788263246.588330:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753708800 00000100:00100000:0.0:1788263246.588389:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263246.588399:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753708800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263246.588431:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263246.588488:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753708800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263246.588495:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788263246.588570:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f7480 x1875129753708800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263246.588589:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753708800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263247.037115:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263248.069792:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263248.123595:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263248.123629:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263248.123663:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263248.123683:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263248.123705:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263248.123730:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735852160 00000100:00100000:3.0:1788263248.123738:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735852160 00000100:00100000:3.0:1788263248.123792:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735852032 00000100:00100000:3.0:1788263248.123795:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735852032 00000100:00100000:3.0:1788263248.123816:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1788263248.123855:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735852160:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263248.123925:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735852160:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 73us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263248.123932:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1788263248.123966:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1788263248.123973:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735852032:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263248.123996:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735852032:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263248.124166:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735851904 00000100:00100000:1.0:1788263248.124171:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735851904 00000100:00100000:1.0:1788263248.124203:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735851776 00000100:00100000:1.0:1788263248.124206:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735851776 00000100:00100000:1.0:1788263248.124249:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1788263248.124257:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735851904:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263248.124288:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735851904:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 33us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263248.124294:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1788263248.124307:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:1.0:1788263248.124313:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735851776:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263248.124346:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735851776:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 33us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263248.124353:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:3.0:1788263248.124412:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00080000:3.0:1788263248.124437:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263248.124442:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263248.124444:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263248.124709:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735851648 00000100:00100000:2.0:1788263248.124714:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735851648 00000100:00100000:2.0:1788263248.124751:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:2.0:1788263248.124759:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2359:x1875129735851648:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263248.124796:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2359:x1875129735851648:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 38us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263248.124802:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 217 00010000:00010000:0.0:1788263249.084518:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263250.109248:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263250.686098:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263250.686141:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753709312:0@lo:400:kworker.0 00000100:00100000:1.0:1788263250.686248:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263250.686314:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753708928:0@lo:400:kworker.0 00000100:00100000:1.0:1788263250.686346:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263250.686376:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263250.686384:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753709440:0@lo:400:kworker.0 00000100:00100000:2.0:1788263250.686388:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753709312 00000100:00100000:2.0:1788263250.686398:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753709312 00000100:00100000:1.0:1788263250.686413:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263250.686451:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753708928 00000100:00100000:1.0:1788263250.686456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753708928 00000100:00100000:2.0:1788263250.686468:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263250.686481:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753709312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263250.686491:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788263250.686499:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753708928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263250.686534:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753708928:12345-0@lo:400:kworker.0 Request processed in 38us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263250.686541:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788263250.686550:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753709312:12345-0@lo:400:kworker.0 Request processed in 71us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263250.686558:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788263250.686569:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753709440 00000100:00100000:1.0:1788263250.686572:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753709440 00000100:00100000:1.0:1788263250.686611:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788263250.686616:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753709440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263250.686636:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753709440:12345-0@lo:400:kworker.0 Request processed in 20us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263250.686639:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788263250.686680:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753709440:0@lo:400:kworker.0 00010000:00080000:1.0:1788263250.686689:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99434623f800 x1875129753709312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263250.686696:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753709312:0@lo:400:kworker.0 00000100:00100000:1.0:1788263250.686701:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753708928:0@lo:400:kworker.0 00000100:00100000:0.0:1788263250.686868:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753709056:0@lo:400:kworker.0 00000100:00100000:0.0:1788263250.686899:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263250.686925:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753709568:0@lo:400:kworker.0 00000100:00100000:0.0:1788263250.686947:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263250.686973:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263250.686980:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753709184:0@lo:400:kworker.0 00000100:00100000:0.0:1788263250.687013:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263250.687041:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753709056 00000100:00100000:0.0:1788263250.687045:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753709056 00000100:00100000:0.0:1788263250.687067:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753709184 00000100:00100000:0.0:1788263250.687070:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753709184 00000100:00100000:0.0:1788263250.687088:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788263250.687094:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753709056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263250.687123:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753709056:12345-0@lo:400:kworker.0 Request processed in 30us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263250.687129:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788263250.687142:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788263250.687155:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753709184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263250.687180:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753709184:12345-0@lo:400:kworker.0 Request processed in 27us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263250.687187:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788263250.687212:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753709184:0@lo:400:kworker.0 00000100:00100000:2.0:1788263250.687312:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753709568 00000100:00100000:2.0:1788263250.687316:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753709568 00000100:00100000:2.0:1788263250.687345:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788263250.687351:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753709568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263250.687383:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753709568:12345-0@lo:400:kworker.0 Request processed in 31us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263250.687389:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788263250.687456:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753709056:0@lo:400:kworker.0 00010000:00080000:0.0:1788263250.687464:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99434623ea00 x1875129753709568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263250.687470:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753709568:0@lo:400:kworker.0 00000100:00080000:3.0:1788263250.687760:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263250.687765:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263250.687766:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788263251.132414:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263251.195441:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263251.195475:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753709696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263251.195562:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263251.195658:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753709696 00000100:00100000:0.0:1788263251.195667:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753709696 00000100:00100000:0.0:1788263251.195726:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263251.195737:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753709696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263251.195787:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263251.195839:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753709696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263251.195845:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788263251.195884:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f6d80 x1875129753709696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263251.195911:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753709696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263251.707729:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753709824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263251.707821:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263251.708173:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753709824 00000100:00100000:0.0:1788263251.708183:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753709824 00000100:00100000:0.0:1788263251.708258:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788263251.708274:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753709824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263251.708328:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263251.708379:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753709824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263251.708384:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788263251.712743:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943509f6d80 x1875129753709824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263251.712773:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753709824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263252.162590:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263253.181397:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263253.226119:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263253.226196:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263253.226284:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263253.226309:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263253.226334:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263253.226362:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735852544 00000100:00100000:0.0:1788263253.226371:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735852544 00000100:00100000:0.0:1788263253.226429:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735852416 00000100:00100000:0.0:1788263253.226433:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735852416 00000100:00100000:0.0:1788263253.226471:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:0.0:1788263253.226482:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735852544:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263253.226561:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735852544:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 81us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263253.226569:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:0.0:1788263253.226586:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:0.0:1788263253.226594:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:2360:x1875129735852416:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263253.226617:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:2360:x1875129735852416:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263253.226623:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00080000:0.0:1788263253.226638:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263253.226819:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735852288 00000100:00100000:2.0:1788263253.226824:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735852288 00000100:00100000:2.0:1788263253.226859:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:2.0:1788263253.226865:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735852288:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263253.226895:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735852288:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263253.226901:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:2.0:1788263253.226927:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735852800 00000100:00100000:2.0:1788263253.226931:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735852800 00000100:00100000:2.0:1788263253.226968:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735852672 00000100:00100000:2.0:1788263253.226971:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735852672 00000100:00100000:2.0:1788263253.226988:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1788263253.226994:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735852800:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263253.227017:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735852800:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263253.227023:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1788263253.227032:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:2.0:1788263253.227038:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735852672:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263253.227054:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735852672:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 16us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263253.227067:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00080000:2.0:1788263253.227131:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263253.227134:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788263254.204462:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263255.227357:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263255.803993:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753709952:0@lo:400:kworker.0 00000100:00100000:1.0:1788263255.804092:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263255.804439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753709952 00000100:00100000:3.0:1788263255.804446:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753709952 00000100:00100000:3.0:1788263255.804491:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788263255.804501:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753709952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263255.804565:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753709952:12345-0@lo:400:kworker.0 Request processed in 65us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263255.804572:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788263255.804715:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753709952:0@lo:400:kworker.0 00000100:00100000:3.0:1788263255.814070:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263255.814110:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753710080:0@lo:400:kworker.0 00000100:00100000:0.0:1788263255.814477:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753710592:0@lo:400:kworker.0 00000100:00100000:0.0:1788263255.814579:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263255.814667:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263255.814680:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753710336:0@lo:400:kworker.0 00000100:00100000:0.0:1788263255.814681:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753710208:0@lo:400:kworker.0 00000100:00100000:1.0:1788263255.814757:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263255.814779:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263255.814861:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753710080 00000100:00100000:3.0:1788263255.814869:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753710080 00000100:00100000:3.0:1788263255.814939:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788263255.814952:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753710080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263255.815019:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753710080:12345-0@lo:400:kworker.0 Request processed in 70us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263255.815026:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788263255.815076:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263255.815113:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753710208 00000100:00100000:3.0:1788263255.815116:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753710208 00000100:00100000:3.0:1788263255.815169:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788263255.815176:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753710208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263255.815215:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753710208:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263255.815241:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788263255.815261:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263255.815299:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753710208:0@lo:400:kworker.0 00000100:00100000:3.0:1788263255.815328:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753710080:0@lo:400:kworker.0 00000100:00100000:0.0:1788263255.815767:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753710464:0@lo:400:kworker.0 00000100:00100000:0.0:1788263255.815814:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263255.816403:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753710464 00000100:00100000:3.0:1788263255.816728:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753710464 00000100:00100000:3.0:1788263255.816796:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788263255.816817:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753710464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263255.816916:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753710464:12345-0@lo:400:kworker.0 Request processed in 100us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263255.816926:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788263255.816957:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263255.817200:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753710464:0@lo:400:kworker.0 00000100:00100000:2.0:1788263255.821995:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753710592 00000100:00100000:2.0:1788263255.822114:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753710592 00000100:00100000:2.0:1788263255.822201:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753710336 00000100:00100000:2.0:1788263255.822205:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753710336 00000100:00100000:2.0:1788263255.822254:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788263255.822265:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753710592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263255.822369:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753710592:12345-0@lo:400:kworker.0 Request processed in 105us (7790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263255.822584:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788263255.822606:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788263255.822613:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753710336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263255.822655:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753710336:12345-0@lo:400:kworker.0 Request processed in 42us (7898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263255.822660:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788263255.822854:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99434623d180 x1875129753710336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263255.822870:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753710336:0@lo:400:kworker.0 00010000:00080000:2.0:1788263255.822915:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99434623e300 x1875129753710592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263255.822926:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753710592:0@lo:400:kworker.0 00000100:00080000:3.0:1788263255.823722:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263255.823729:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788263256.252331:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263256.317960:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753710720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263256.318475:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263256.318572:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753710720 00000100:00100000:0.0:1788263256.318581:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753710720 00000100:00100000:0.0:1788263256.318643:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788263256.318654:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753710720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263256.318695:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263256.319167:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753710720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 514us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263256.319176:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788263256.319294:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437f6ead80 x1875129753710720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263256.319313:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753710720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263256.829212:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263256.829257:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753710848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263256.829329:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263256.829398:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753710848 00000100:00100000:3.0:1788263256.829406:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753710848 00000100:00100000:3.0:1788263256.829457:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788263256.829468:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753710848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263256.829501:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263256.829540:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753710848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263256.829546:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788263256.829584:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bd1880 x1875129753710848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263256.829603:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753710848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263257.277309:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263258.299392:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263258.342431:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263258.342480:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263258.342506:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263258.342536:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735852928 00000100:00100000:3.0:1788263258.342554:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735852928 00000100:00100000:3.0:1788263258.342599:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:3.0:1788263258.342609:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735852928:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263258.342679:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735852928:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263258.342687:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:3.0:1788263258.342720:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735853056 00000100:00100000:3.0:1788263258.342724:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735853056 00000100:00100000:3.0:1788263258.342754:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735853184 00000100:00100000:2.0:1788263258.342924:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:2.0:1788263258.342935:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+6:2360:x1875129735853056:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263258.342968:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+6:2360:x1875129735853056:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263258.342974:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:3.0:1788263258.345028:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735853184 00000100:00100000:3.0:1788263258.345110:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:3.0:1788263258.345120:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735853184:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263258.345195:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735853184:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 77us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263258.345203:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00080000:3.0:1788263258.345250:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263258.345308:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263258.345407:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263258.345737:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735853312 00000100:00100000:2.0:1788263258.345747:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735853312 00000100:00100000:2.0:1788263258.345791:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735853440 00000100:00100000:2.0:1788263258.345794:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735853440 00000100:00100000:2.0:1788263258.345821:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1788263258.345828:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2358:x1875129735853312:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:2.0:1788263258.345854:0:8112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955be6 00000100:00080000:2.0:1788263258.345873:0:8112:0:(import.c:65:import_set_state_nolock()) ffff99434647a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263258.345921:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788263258.346322:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+2:2358:x1875129735853312:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 493us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263258.346330:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1788263258.346347:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1788263258.346354:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2358:x1875129735853440:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:2.0:1788263258.346366:0:8112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955bdf 00000100:00080000:2.0:1788263258.346373:0:8112:0:(import.c:65:import_set_state_nolock()) ffff99437a6b2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263258.346393:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788263258.346584:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:584ba373-7851-453b-ba8f-f510758f1581+2:2358:x1875129735853440:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 230us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263258.346591:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:2.0:1788263258.346633:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263258.346638:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788263258.346789:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263258.346793:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788263259.323485:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788263259.479191:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 584ba373-7851-453b-ba8f-f510758f1581 00000020:00000080:0.0:1788263259.479203:0:7662:0:(genops.c:885:class_export_put()) final put ffff99437a6b4000/584ba373-7851-453b-ba8f-f510758f1581 00000020:00000080:1.0:1788263259.479343:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff99437a6b4000/584ba373-7851-453b-ba8f-f510758f1581 for lustre-OST0001 00000020:00000080:1.0:1788263259.479456:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99437a6b2800 for lustre-OST0001 00010000:00010000:1.0:1788263260.349515:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788263260.478624:0:11038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788263260.923468:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753711232:0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.923536:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263260.923594:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788263260.923599:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753711104:0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.923619:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263260.923631:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753711616:0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.923650:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263260.923679:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753711232 00000100:00100000:2.0:1788263260.923685:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753711232 00000100:00100000:2.0:1788263260.923731:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753711104 00000100:00100000:2.0:1788263260.923734:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753711104 00000100:00100000:2.0:1788263260.923755:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788263260.923763:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753711232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.923812:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753711232:12345-0@lo:400:kworker.0 Request processed in 49us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263260.923830:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788263260.923846:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788263260.923852:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753711104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.923875:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753711104:12345-0@lo:400:kworker.0 Request processed in 25us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263260.923881:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788263260.923896:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753711616 00000100:00100000:2.0:1788263260.923899:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753711616 00000100:00100000:2.0:1788263260.923921:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263260.923926:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753711616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.923964:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753711616:12345-0@lo:400:kworker.0 Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263260.923970:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263260.924002:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753711104:0@lo:400:kworker.0 00010000:00080000:2.0:1788263260.924013:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99434623ed80 x1875129753711616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263260.924023:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753711616:0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.924030:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753711232:0@lo:400:kworker.0 00000100:00100000:3.0:1788263260.924188:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753710976:0@lo:400:kworker.0 00000100:00100000:3.0:1788263260.924268:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263260.924298:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753711488:0@lo:400:kworker.0 00000100:00100000:3.0:1788263260.924320:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263260.924337:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263260.924343:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753711360:0@lo:400:kworker.0 00000100:00100000:3.0:1788263260.924365:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263260.924399:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753711488 00000100:00100000:3.0:1788263260.924403:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753711488 00000100:00100000:3.0:1788263260.924428:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788263260.924433:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753711488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263260.924467:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753711488:12345-0@lo:400:kworker.0 Request processed in 33us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263260.924473:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788263260.924490:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263260.924494:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263260.924523:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753711488:0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.924621:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753710976 00000100:00100000:2.0:1788263260.924625:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753710976 00000100:00100000:2.0:1788263260.924659:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788263260.924665:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753710976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.924753:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753710976:12345-0@lo:400:kworker.0 Request processed in 87us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263260.924759:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788263260.924787:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753711360 00000100:00100000:2.0:1788263260.924790:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753711360 00000100:00100000:2.0:1788263260.924826:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788263260.924833:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753711360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263260.924861:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753711360:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263260.924867:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788263260.925171:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263260.926554:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753710976:0@lo:400:kworker.0 00010000:00080000:0.0:1788263260.926590:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99434623c700 x1875129753711360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263260.926602:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753711360:0@lo:400:kworker.0 00010000:00010000:2.0:1788263261.371429:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263261.436143:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263261.436166:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753711744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263261.436260:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263261.436324:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753711744 00000100:00100000:0.0:1788263261.436331:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753711744 00000100:00100000:0.0:1788263261.436393:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788263261.436403:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753711744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263261.436442:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263261.436489:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753711744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263261.436496:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788263261.436537:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bd5500 x1875129753711744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263261.436554:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753711744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263261.953419:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263261.953444:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753711872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263261.953531:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263261.953615:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753711872 00000100:00100000:2.0:1788263261.953626:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753711872 00000100:00100000:2.0:1788263261.954849:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263261.954863:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753711872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263261.954900:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263261.955019:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753711872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263261.955026:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788263261.957877:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99434623df80 x1875129753711872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263261.957906:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753711872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263262.395940:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788263262.542158:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 584ba373-7851-453b-ba8f-f510758f1581 00000020:00000080:2.0:1788263262.542167:0:6729:0:(genops.c:885:class_export_put()) final put ffff99434647c800/584ba373-7851-453b-ba8f-f510758f1581 00000020:00000080:3.0:1788263262.542339:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99434647c800/584ba373-7851-453b-ba8f-f510758f1581 for lustre-OST0000 00000020:00000080:3.0:1788263262.542394:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99434647a000 for lustre-OST0000 00010000:00010000:2.0:1788263263.419383:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263263.461431:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263263.461690:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735853568 00000100:00100000:3.0:1788263263.461700:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735853568 00000100:00100000:3.0:1788263263.461784:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:3.0:1788263263.461795:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2362:x1875129735853568:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263263.461873:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2362:x1875129735853568:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 81us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263263.461881:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:2.0:1788263263.473815:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263263.473917:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735853696 00000100:00100000:0.0:1788263263.473926:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735853696 00000100:00100000:0.0:1788263263.474057:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:0.0:1788263263.474069:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735853696:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263263.474156:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735853696:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 89us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.474164:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00080000:1.0:1788263263.474197:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263263.477808:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263263.477884:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735853824 00000100:00100000:0.0:1788263263.477894:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735853824 00000100:00100000:0.0:1788263263.477994:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:0.0:1788263263.478018:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735853824:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263263.478096:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735853824:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 80us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.478104:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00080000:1.0:1788263263.478455:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788263263.599655:0:11188:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda59dee90 20000000:00000080:1.0:1788263263.599688:0:11188:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994242763400 uarg=0000000000000000 20000000:01000000:1.0:1788263263.599735:0:11188:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788263263.599741:0:11188:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788263263.599746:0:11188:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788263263.600576:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788263263.600642:0:11188:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788263263.605354:0:11188:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788263263.605389:0:11188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605410:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f6a expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605418:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955b99 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605425:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955ba7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605431:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955bb5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605437:0:11188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fa2 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605444:0:11188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605489:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fa2 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605506:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fa2 expref: 12 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263263.605539:0:11188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712000:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263263.605713:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955bb5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605721:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955bb5 expref: 18 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263263.605742:0:11188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712128:0@lo:104: 00000100:00100000:1.0:1788263263.605797:0:11188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263263.605842:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955ba7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605850:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955ba7 expref: 18 pid: 5847 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263263.605857:0:11188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712256:0@lo:104: 00000100:00100000:1.0:1788263263.605879:0:11188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263263.605931:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955b99 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.605939:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955b99 expref: 18 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263263.605947:0:11188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712384:0@lo:104: 00000100:00100000:1.0:1788263263.605970:0:11188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263263.605987:0:11188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f6a expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.606006:0:11188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f6a expref: 12 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263263.606015:0:11188:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712512:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263263.606039:0:11188:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943507ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263263.606068:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753712128 00000100:00100000:0.0:1788263263.606075:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753712128 00000100:00100000:0.0:1788263263.606122:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753712256 00000100:00100000:0.0:1788263263.606125:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753712256 00000100:00100000:0.0:1788263263.606135:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753712384 00000100:00100000:0.0:1788263263.606137:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753712384 00000100:00100000:0.0:1788263263.606150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263263.606157:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:11188:x1875129753712128:12345-0@lo:104: 00010000:00010000:0.0:1788263263.606170:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263263.606359:0:11188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712128:0@lo:104: 00010000:00010000:0.0:1788263263.606760:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263263.606777:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+5:11188:x1875129753712128:12345-0@lo:104: Request processed in 610us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.606786:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263263.606807:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263263.606815:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:11188:x1875129753712256:12345-0@lo:104: 00010000:00010000:0.0:1788263263.606823:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.606842:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263263.606848:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.606855:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382043e00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263263.606860:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.606869:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263263.606877:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263263.606883:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788263263.606913:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.606920:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263263.606940:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.606947:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994382043e00/0x1a657bc513955bb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955bbc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.606969:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263263.606971:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263263.606973:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263263.606987:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753712640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263263.607024:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263263.607067:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753712640 00000100:00100000:1.0:1788263263.607072:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753712640 00010000:00010000:1.0:1788263263.607092:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955bb5 expref: 19 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263263.607113:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788263263.607119:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753712640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263263.607129:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263263.607133:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955bb5 expref: 19 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607142:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955bb5 expref: 19 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607155:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d6c00/0x1a657bc513955bbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955bb5 expref: 19 pid: 5846 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607168:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263263.607192:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc92050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:3321:x1875129753712640:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263263.607198:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788263263.607281:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753712640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263263.607343:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263263.607349:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:11188:x1875129753712256:12345-0@lo:104: Request processed in 536us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.607356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788263263.607357:0:11188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712256:0@lo:104: 00000100:00100000:0.0:1788263263.607369:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263263.607376:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:11188:x1875129753712384:12345-0@lo:104: 00010000:00010000:0.0:1788263263.607384:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607394:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263263.607398:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607404:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031200 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263263.607407:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607414:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263263.607421:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263263.607427:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263263.607427:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263263.607437:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:11188:x1875129753712384:12345-0@lo:104: Request processed in 62us (1465us total) trans 0 rc 0/0 00010000:00010000:1.0:1788263263.607440:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263263.607443:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788263263.607446:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263263.607464:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607471:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994340031200/0x1a657bc513955ba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955bae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607480:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263263.607483:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607488:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030e00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263263.607495:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607502:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263263.607508:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263263.607513:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788263263.607554:0:11188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712384:0@lo:104: 00010000:00010000:1.0:1788263263.607591:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607598:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263263.607604:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607609:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994340030e00/0x1a657bc513955b99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955ba0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263263.607622:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263263.607624:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263263.607625:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263263.607635:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753712768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263263.607662:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263263.607806:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263263.607812:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753712896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263263.607835:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263263.608346:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263263.608454:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753712768 00000100:00100000:3.0:1788263263.608460:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753712768 00010000:00010000:3.0:1788263263.608486:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955ba7 expref: 18 pid: 5847 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.608552:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753712896 00000100:00100000:3.0:1788263263.608556:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753712896 00010000:00010000:3.0:1788263263.608570:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955b99 expref: 19 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263263.608600:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263263.608608:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753712768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263263.608618:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263263.608624:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955ba7 expref: 19 pid: 5847 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.608632:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955ba7 expref: 19 pid: 5847 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.608644:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994382042c00/0x1a657bc513955bae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955ba7 expref: 19 pid: 5847 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.608656:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263263.608714:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:3322:x1875129753712768:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263263.608736:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263263.608753:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263263.608759:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3322:x1875129753712896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263263.608780:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263263.608785:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955b99 expref: 17 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.608793:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955b99 expref: 17 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.608802:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031e00/0x1a657bc513955ba0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955b99 expref: 17 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.608810:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263263.608832:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3322:x1875129753712896:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263263.608837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263263.608895:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753712896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263263.608903:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753712768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263263.610496:0:11188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6eaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712000:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263263.610510:0:11188:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11188:1875129753712512:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263263.610542:0:11188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263263.611425:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263263.611533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263263.612117:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735853952 00000100:00100000:1.0:1788263263.612126:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735853952 00010000:00010000:1.0:1788263263.612176:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fa2 expref: 13 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263263.612246:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735854080 00000100:00100000:0.0:1788263263.612250:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735854080 00010000:00010000:0.0:1788263263.612268:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f6a expref: 14 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263263.612295:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:0.0:1788263263.612305:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b18c11e-0696-4540-97e4-82aaa1c0495b+14:2361:x1875129735853952:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263263.612318:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263263.612323:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fa2 expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612335:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fa2 expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612353:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d6a00/0x1a657bc513955bd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fa2 expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612369:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263263.612427:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735853952:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 122us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.612434:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:0.0:1788263263.612452:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:0.0:1788263263.612466:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:2361:x1875129735854080:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263263.612473:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263263.612477:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f6a expref: 12 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612485:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f6a expref: 12 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612495:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d6600/0x1a657bc513955b92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f6a expref: 12 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612505:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612513:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612528:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612535:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612542:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612548:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612555:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263263.612559:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612573:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612587:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.612596:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263263.612615:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:2361:x1875129735854080:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 150us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.612622:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00010000:00010000:3.0:1788263263.612712:0:11188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.612729:0:11188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.612735:0:11188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343158400/0x1a657bc513955bed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263264.446763:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263264.871412:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263264.871847:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735854208 00000100:00100000:3.0:1788263264.871857:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735854208 00000100:00100000:3.0:1788263264.871919:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 224 00000100:00100000:3.0:1788263264.871929:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:5599:x1875129735854208:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263264.871946:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263264.871967:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2fcc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.871994:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fcc expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.872031:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fcc expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.872039:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943821f5000, rc 0) 00000100:00100000:3.0:1788263264.872103:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735854208:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 176us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263264.872110:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 224 00000100:00100000:3.0:1788263264.874907:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263264.878104:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735854336 00000100:00100000:1.0:1788263264.878119:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735854336 00000100:00100000:1.0:1788263264.878193:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:1.0:1788263264.878203:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735854336:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263264.878511:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735854336:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 308us (3613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263264.878520:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:3.0:1788263264.886334:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263264.886371:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735854464 00000100:00100000:3.0:1788263264.886382:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735854464 00000100:00100000:3.0:1788263264.886434:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 226 00000100:00100000:3.0:1788263264.886444:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735854464:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.886650:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735854464:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 206us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263264.891418:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 226 00000100:00100000:1.0:1788263264.893148:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263264.893308:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735854592 00000100:00100000:0.0:1788263264.893318:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735854592 00000100:00100000:0.0:1788263264.893370:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:0.0:1788263264.893381:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735854592:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263264.893399:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263264.893418:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2fd3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263264.893445:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fd3 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263264.893455:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fd3 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263264.893465:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382042200, rc 0) 00000100:00100000:0.0:1788263264.893531:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735854592:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 151us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263264.893549:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:1.0:1788263264.900029:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263264.901344:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735854720 00000100:00100000:2.0:1788263264.901358:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735854720 00000100:00100000:2.0:1788263264.901416:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 228 00000100:00100000:2.0:1788263264.901426:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735854720:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.901720:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735854720:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 294us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.901729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 228 00000100:00100000:3.0:1788263264.907338:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263264.907887:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735854848 00000100:00100000:0.0:1788263264.907898:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735854848 00000100:00100000:0.0:1788263264.907960:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:0.0:1788263264.907986:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735854848:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263264.908235:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735854848:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 246us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263264.908244:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 229 10000000:01000000:0.0:1788263265.340652:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263265.340661:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994375782000 from 7 10000000:01000000:0.0:1788263265.340668:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263265.340731:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263265.340754:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263265.340767:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263265.340794:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263265.340867:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263265.340924:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788263265.340989:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753713024 00000100:00100000:3.0:1788263265.340997:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753713024 00000100:00100000:3.0:1788263265.341051:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788263265.341061:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753713024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263265.341074:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263265.341087:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955c02 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263265.341109:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955c02 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263265.341135:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955c02 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263265.341143:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943821f4400, rc 0) 00000100:00100000:3.0:1788263265.341185:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753713024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263265.341192:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788263265.341255:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263265.341281:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263265.341291:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263265.341344:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263265.341369:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263265.341385:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263265.341398:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753713152 00000100:00100000:3.0:1788263265.341402:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753713152 00000100:00100000:3.0:1788263265.341422:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788263265.341429:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753713152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263265.341659:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753713152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263265.341666:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788263265.341695:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263265.341729:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263265.341778:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263265.341792:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263265.341802:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753713280 00000100:00100000:3.0:1788263265.341806:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753713280 00000100:00100000:3.0:1788263265.341825:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788263265.341831:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753713280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263265.341961:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753713280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263265.341967:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788263265.342000:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788263265.343692:0:11272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788263265.343946:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788263265.343966:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263265.343976:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263265.343987:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263265.343996:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788263265.343999:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99438144e800 from 7 10000000:01000000:3.0:1788263265.344003:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263265.344036:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263265.344044:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263265.344070:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263265.344091:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263265.344142:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263265.344173:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349afd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263265.344254:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753713408 00000100:00100000:0.0:1788263265.344260:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753713408 00000100:00100000:0.0:1788263265.344313:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788263265.344322:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753713408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263265.344344:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263265.344357:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955c10 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263265.344378:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955c10 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263265.344387:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955c10 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263265.344395:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382042400, rc 0) 00000100:00100000:0.0:1788263265.344436:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753713408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263265.344442:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788263265.344617:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263265.344632:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263265.344860:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263265.344913:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263265.344941:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263265.344958:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263265.345015:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753713536 00000100:00100000:0.0:1788263265.345019:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753713536 00000100:00100000:0.0:1788263265.345050:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788263265.345057:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753713536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263265.345499:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753713536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 442us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263265.345507:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788263265.345595:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263265.345625:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263265.345679:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263265.345704:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263265.345758:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753713664 00000100:00100000:3.0:1788263265.345763:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753713664 00000100:00100000:3.0:1788263265.345786:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788263265.345794:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753713664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263265.345955:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753713664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263265.345962:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788263265.346164:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788263265.347802:0:11273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788263265.347858:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788263265.347876:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263265.347888:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263265.347899:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263265.347909:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788263265.347912:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994350979800 from 7 10000000:01000000:1.0:1788263265.347915:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263265.347947:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263265.347953:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263265.347963:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263265.347987:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263265.348051:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263265.348084:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263265.348522:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753713792 00000100:00100000:0.0:1788263265.348529:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753713792 00000100:00100000:0.0:1788263265.348578:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788263265.348587:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753713792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263265.348600:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263265.348613:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955c1e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263265.348666:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955c1e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263265.348676:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955c1e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263265.348684:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382042c00, rc 0) 00000100:00100000:0.0:1788263265.348731:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753713792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263265.348747:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788263265.349037:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263265.349052:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263265.349067:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263265.349122:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263265.349151:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263265.349181:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263265.351951:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753713920 00000100:00100000:0.0:1788263265.351964:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753713920 00000100:00100000:0.0:1788263265.352042:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788263265.352053:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753713920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263265.352385:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753713920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263265.352394:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788263265.352817:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753713920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263265.352883:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753714048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263265.352933:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263265.352963:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263265.353138:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753714048 00000100:00100000:1.0:1788263265.353144:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753714048 00000100:00100000:1.0:1788263265.353186:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788263265.353194:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753714048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263265.353370:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753714048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263265.353378:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788263265.353421:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753714048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788263265.356022:0:11274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788263265.356096:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788263265.356117:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263265.356129:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263265.356140:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263265.470198:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263266.043427:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753714432:0@lo:400:kworker.0 00000100:00100000:0.0:1788263266.043498:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263266.043562:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263266.043568:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753714560:0@lo:400:kworker.0 00000100:00100000:0.0:1788263266.043589:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263266.043621:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753714432 00000100:00100000:1.0:1788263266.043718:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753714176:0@lo:400:kworker.0 00000100:00100000:1.0:1788263266.043766:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263266.043784:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753714688:0@lo:400:kworker.0 00000100:00100000:1.0:1788263266.043803:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263266.043824:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263266.043830:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753714304:0@lo:400:kworker.0 00000100:00100000:1.0:1788263266.043849:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263266.043925:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753714688 00000100:00100000:2.0:1788263266.043933:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753714688 00000100:00100000:2.0:1788263266.043998:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263266.044009:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753714688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263266.044062:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753714688:12345-0@lo:400:kworker.0 Request processed in 55us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263266.044070:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788263266.044114:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bd5880 x1875129753714688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263266.044129:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753714688:0@lo:400:kworker.0 00000100:00080000:1.0:1788263266.044268:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788263266.044535:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753714432 00000100:00100000:0.0:1788263266.044576:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263266.044583:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753714432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263266.044705:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753714432:12345-0@lo:400:kworker.0 Request processed in 122us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263266.044712:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263266.044745:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753714560 00000100:00100000:0.0:1788263266.044749:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753714560 00000100:00100000:0.0:1788263266.044776:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753714176 00000100:00100000:0.0:1788263266.044779:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753714176 00000100:00100000:0.0:1788263266.044791:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753714304 00000100:00100000:0.0:1788263266.044794:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753714304 00000100:00100000:0.0:1788263266.044807:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788263266.044813:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753714560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263266.044844:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753714560:12345-0@lo:400:kworker.0 Request processed in 31us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263266.044850:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788263266.044863:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788263266.044868:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753714176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263266.044900:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753714176:12345-0@lo:400:kworker.0 Request processed in 31us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263266.044905:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788263266.044916:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788263266.044922:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753714304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263266.044947:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753714304:12345-0@lo:400:kworker.0 Request processed in 26us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263266.044952:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788263266.044989:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753714560:0@lo:400:kworker.0 00010000:00080000:0.0:1788263266.045002:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bd7100 x1875129753714432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263266.045018:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753714432:0@lo:400:kworker.0 00000100:00100000:0.0:1788263266.045047:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753714304:0@lo:400:kworker.0 00000100:00100000:0.0:1788263266.045057:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753714176:0@lo:400:kworker.0 00000100:00080000:1.0:1788263266.045242:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263266.045246:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788263266.491399:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263266.555373:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263266.555394:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753714816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263266.555467:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263266.555541:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753714816 00000100:00100000:0.0:1788263266.555552:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753714816 00000100:00100000:0.0:1788263266.555616:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263266.555625:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753714816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263266.555662:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263266.555702:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753714816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263266.555708:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788263266.555760:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bd7480 x1875129753714816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263266.555778:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753714816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263267.070117:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753714944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263267.070195:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263267.070319:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753714944 00000100:00100000:2.0:1788263267.070328:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753714944 00000100:00100000:2.0:1788263267.070378:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788263267.070388:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753714944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263267.070423:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263267.075286:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753714944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4888us (5080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263267.075302:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788263267.077937:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bd2300 x1875129753714944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263267.077978:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753714944:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788263267.435367:0:11386:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788263267.524736:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263268.539466:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263268.588945:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263268.589011:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263268.589054:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263268.589420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735854976 00000100:00100000:2.0:1788263268.589431:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735854976 00000100:00100000:2.0:1788263268.589496:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 239 00000100:00100000:2.0:1788263268.589506:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735854976:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263268.589607:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735854976:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 102us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263268.589615:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 239 00000100:00100000:3.0:1788263268.589920:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735855232 00000100:00100000:3.0:1788263268.589925:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735855232 00000100:00100000:3.0:1788263268.589990:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735855104 00000100:00100000:3.0:1788263268.589994:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735855104 00000100:00100000:3.0:1788263268.590019:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:3.0:1788263268.590026:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735855232:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263268.590067:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2360:x1875129735855232:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 41us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263268.590074:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:3.0:1788263268.590088:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:3.0:1788263268.590095:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:2360:x1875129735855104:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263268.590132:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:2360:x1875129735855104:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 37us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263268.590146:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00080000:1.0:1788263268.590374:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788263269.565542:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263270.589184:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263271.172146:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753715072:0@lo:400:kworker.0 00000100:00100000:2.0:1788263271.172249:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263271.172304:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263271.172311:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753715456:0@lo:400:kworker.0 00000100:00100000:2.0:1788263271.172338:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263271.172369:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753715072 00000100:00100000:2.0:1788263271.172376:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753715072 00000100:00100000:1.0:1788263271.172461:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263271.172470:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753715584:0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.172502:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263271.172532:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753715200:0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.172555:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263271.172572:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753715712:0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.172592:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263271.172610:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263271.172615:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753715328:0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.172659:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263271.172691:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753715584 00000100:00100000:1.0:1788263271.172695:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753715584 00000100:00100000:1.0:1788263271.172734:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753715200 00000100:00100000:1.0:1788263271.172737:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753715200 00000100:00100000:1.0:1788263271.172749:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753715328 00000100:00100000:1.0:1788263271.172752:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753715328 00000100:00100000:1.0:1788263271.172767:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788263271.172775:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753715584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.172832:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753715584:12345-0@lo:400:kworker.0 Request processed in 57us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263271.172839:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788263271.172855:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788263271.172861:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753715200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.172890:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753715200:12345-0@lo:400:kworker.0 Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263271.172895:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788263271.172907:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788263271.172913:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753715328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.172939:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753715328:12345-0@lo:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263271.172944:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788263271.172966:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753715456 00000100:00100000:1.0:1788263271.172969:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753715456 00000100:00100000:1.0:1788263271.172993:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753715712 00000100:00100000:1.0:1788263271.172996:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753715712 00000100:00100000:1.0:1788263271.173015:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263271.173021:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753715456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.173058:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753715456:12345-0@lo:400:kworker.0 Request processed in 37us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263271.173064:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263271.173076:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788263271.173082:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753715712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.173107:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753715712:12345-0@lo:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263271.173113:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788263271.173134:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263271.173137:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263271.173140:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263271.173172:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753715584:0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.173201:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753715328:0@lo:400:kworker.0 00000100:00100000:1.0:1788263271.173210:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753715200:0@lo:400:kworker.0 00010000:00080000:1.0:1788263271.173243:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994379ef7100 x1875129753715712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263271.173253:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753715712:0@lo:400:kworker.0 00010000:00080000:1.0:1788263271.173282:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994379ef6d80 x1875129753715456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263271.173291:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753715456:0@lo:400:kworker.0 00000100:00100000:2.0:1788263271.173391:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788263271.173402:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753715072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263271.173442:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753715072:12345-0@lo:400:kworker.0 Request processed in 43us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.173448:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788263271.173559:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753715072:0@lo:400:kworker.0 00000001:02000400:2.0:1788263271.333907:0:11487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:47:49 (1788263269) === 00000100:00100000:1.0:1788263271.579973:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263271.580061:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.580172:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735855488 00000100:00100000:2.0:1788263271.580183:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735855488 00000100:00100000:2.0:1788263271.580279:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788263271.580289:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fedef325-db54-4469-b29a-301ff58466df+6:9678:x1875129735855488:12345-192.168.201.29@tcp:700:mkdir.0 00000100:00100000:2.0:1788263271.580370:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fedef325-db54-4469-b29a-301ff58466df+6:9678:x1875129735855488:12345-192.168.201.29@tcp:700:mkdir.0 Request processed in 82us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.580377:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00080000:1.0:1788263271.580436:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263271.580637:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735855360 00000100:00100000:3.0:1788263271.580643:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735855360 00000100:00100000:3.0:1788263271.580685:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1788263271.580692:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735855360:12345-192.168.201.29@tcp:41:mkdir.0 00000004:00000024:3.0:1788263271.580721:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788263271.580783:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735855360:12345-192.168.201.29@tcp:41:mkdir.0 Request processed in 91us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263271.580790:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788263271.586088:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.586210:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735855744 00000100:00100000:2.0:1788263271.586250:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735855744 00000100:00100000:2.0:1788263271.586295:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1788263271.586303:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:9678:x1875129735855744:12345-192.168.201.29@tcp:36:mkdir.0 00010000:00010000:2.0:1788263271.586352:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263271.586377:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955b0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f55 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.586393:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99434314f500) 00010000:00010000:2.0:1788263271.586401:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263271.586702:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.586714:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.586721:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.586745:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.586750:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.586754:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263271.587792:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788263271.587808:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.587816:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.587829:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.587834:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263271.587839:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.587846:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.587859:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99434314f600) 00010000:00010000:2.0:1788263271.587862:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263271.587866:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.587872:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c2c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263271.587889:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050ec7cf1 reply state 0000000099ae22b7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263271.587898:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263271.588458:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+7:9678:x1875129735855744:12345-192.168.201.29@tcp:36:mkdir.0 Request processed in 2149us (2372us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788263271.588468:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:0.0:1788263271.593054:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.593072:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.593079:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.593085:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263271.593089:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.593096:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.593116:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99434314fa00) 00010000:00010000:0.0:1788263271.593119:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263271.593124:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.593131:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955c33 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263271.597105:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263271.597198:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735855872 00000100:00100000:3.0:1788263271.597209:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735855872 00000100:00100000:3.0:1788263271.597295:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788263271.597305:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+6:9679:x1875129735855872:12345-192.168.201.29@tcp:101:chmod.0 00010000:00010000:3.0:1788263271.597327:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263271.597353:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955c3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2fda expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.597413:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955c41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.597427:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955c41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.597439:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955c41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263271.597601:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263271.597606:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263271.597657:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955c41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.597702:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955c3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fda expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.597719:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955c41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fda expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.597727:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:2.0:1788263271.597729:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263271.597732:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943821f4e00, rc 0) 00000100:00100000:2.0:1788263271.597787:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+7:9679:x1875129735855872:12345-192.168.201.29@tcp:101:chmod.0 Request processed in 484us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.597794:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788263271.600181:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263271.600718:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735856128 00000100:00100000:0.0:1788263271.600727:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735856128 00000100:00100000:1.0:1788263271.600854:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:1.0:1788263271.600865:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+7:9679:x1875129735856128:12345-192.168.201.29@tcp:36:chmod.0 00010000:00010000:1.0:1788263271.600914:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263271.600940:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955c41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fda expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.600958:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:1.0:1788263271.601022:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263271.601049:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.601061:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.601069:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263271.601527:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000666e1548 reply state 00000000709a689f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263271.601588:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788263271.601596:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788263271.601724:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+8:9679:x1875129735856128:12345-192.168.201.29@tcp:36:chmod.0 Request processed in 859us (1549us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788263271.601732:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00010000:00010000:1.0:1788263271.609722:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.609742:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.609763:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.609769:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263271.609773:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.609781:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.609797:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:1.0:1788263271.609800:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788263271.609804:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.609810:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c48 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.612205:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263271.638442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263271.639186:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735856256 00000100:00100000:1.0:1788263271.639198:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735856256 00000100:00100000:1.0:1788263271.639358:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1788263271.639370:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+7:9680:x1875129735856256:12345-192.168.201.29@tcp:101:chown.0 00010000:00010000:0.0:1788263271.639424:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263271.639458:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513955c4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2fe1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.639757:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955c56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.639773:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955c56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.639787:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955c56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263271.639824:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788263271.639828:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263271.639947:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955c56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.640036:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513955c4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fe1 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.640134:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955c56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fe1 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.640143:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cabe00) 00010000:00010000:0.0:1788263271.640145:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263271.640149:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658800, rc 0) 00000100:00100000:0.0:1788263271.640322:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+8:9680:x1875129735856256:12345-192.168.201.29@tcp:101:chown.0 Request processed in 954us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263271.640330:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788263271.649066:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.653719:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735856384 00000100:00100000:2.0:1788263271.653743:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735856384 00000100:00100000:2.0:1788263271.653846:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1788263271.653859:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+8:9680:x1875129735856384:12345-192.168.201.29@tcp:101:chown.0 00010000:00010000:2.0:1788263271.653886:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263271.653914:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2fe8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654203:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654242:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654258:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654296:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654303:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654310:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654428:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955c72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654437:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654443:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263271.654481:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263271.654486:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263271.654513:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654825:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654835:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654843:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654861:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263271.654867:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654875:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654890:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cabe00) 00010000:00010000:2.0:1788263271.654894:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263271.654899:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654905:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654922:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654929:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654935:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654940:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263271.654943:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654949:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.654967:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99434314f600) 00010000:00010000:2.0:1788263271.654970:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263271.654973:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.655110:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.655158:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fe8 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.655174:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fe8 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.655182:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314f500) 00010000:00010000:2.0:1788263271.655185:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263271.655188:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263271.655675:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+9:9680:x1875129735856384:12345-192.168.201.29@tcp:101:chown.0 Request processed in 1814us (6621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.655685:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1788263271.662099:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263271.662728:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735856640 00000100:00100000:1.0:1788263271.662743:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735856640 00000100:00100000:1.0:1788263271.662868:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788263271.662891:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+9:9680:x1875129735856640:12345-192.168.201.29@tcp:36:chown.0 00010000:00010000:1.0:1788263271.662950:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263271.662986:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955c72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fe8 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.663034:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314f500) 00010000:00010000:1.0:1788263271.663058:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263271.663090:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.663104:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.663117:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263271.676370:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263271.676396:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753715840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263271.676474:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263271.676722:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753715840 00000100:00100000:0.0:1788263271.676731:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753715840 00000100:00100000:0.0:1788263271.676798:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263271.676808:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753715840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263271.676844:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263271.676897:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753715840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263271.676904:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788263271.676940:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bd7100 x1875129753715840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263271.676957:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753715840:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788263271.698252:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788263271.698372:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0dd5bc2 reply state 0000000038047072 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263271.698388:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788263271.698418:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1788263271.698713:0:5853:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788263271.698734:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+7:9680:x1875129735856640:12345-192.168.201.29@tcp:36:chown.0 Request processed in 35851us (36648us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788263271.698744:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00010000:00010000:0.0:1788263271.698817:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.698827:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.698835:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.698841:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263271.698846:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.698859:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.698875:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:0.0:1788263271.698878:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788263271.698882:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.698897:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955c79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263271.721823:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263271.721945:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735856768 00000100:00100000:1.0:1788263271.721957:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735856768 00000100:00100000:1.0:1788263271.722035:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788263271.722048:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:9681:x1875129735856768:12345-192.168.201.29@tcp:101:touch.500 00010000:00010000:1.0:1788263271.722082:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263271.722110:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955c80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2fef expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788263271.724514:0:6725:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2333us 00010000:00010000:2.0:1788263271.747890:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.747915:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.747927:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.747944:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.747952:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.747958:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748583:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748594:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748602:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263271.748641:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263271.748646:0:6725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263271.748689:0:6725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748702:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748708:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748715:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748721:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263271.748725:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748732:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748745:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cabe00) 00010000:00010000:2.0:1788263271.748748:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263271.748752:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748758:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955c87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748769:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748785:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748791:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748796:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263271.748800:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748806:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748814:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99434314f600) 00010000:00010000:2.0:1788263271.748816:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263271.748819:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748824:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955c8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748863:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955c80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fef expref: 8 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748880:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fef expref: 7 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.748887:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263271.748889:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788263271.748897:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7c00, rc 0) 00000100:00100000:2.0:1788263271.749015:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+7:9681:x1875129735856768:12345-192.168.201.29@tcp:101:touch.500 Request processed in 26968us (27204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.749025:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:0.0:1788263271.754633:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263271.754712:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735857024 00000100:00100000:3.0:1788263271.754721:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735857024 00000100:00100000:3.0:1788263271.754769:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1788263271.754779:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+7:9681:x1875129735857024:12345-192.168.201.29@tcp:101:touch.500 00010000:00010000:3.0:1788263271.754808:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263271.754832:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4000/0x1a657bc513955c9c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2ff6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.755113:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.755128:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.755138:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.755179:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.755187:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.755194:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263271.755834:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788263271.756055:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955cb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756076:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756084:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756119:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756124:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756129:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756133:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f5600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263271.756136:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756140:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756149:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263271.756150:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263271.756154:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756158:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955ca3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263271.756168:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000684df424 reply state 000000001ed13d04 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263271.756178:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788263271.756204:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4000/0x1a657bc513955c9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ff6 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756244:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ff6 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.756253:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:3.0:1788263271.756255:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263271.756257:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943821f4600, rc 0) 00000100:00100000:3.0:1788263271.756321:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+10:9681:x1875129735857024:12345-192.168.201.29@tcp:101:touch.500 Request processed in 1544us (1707us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788263271.756326:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00010000:00010000:0.0:1788263271.763188:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.763210:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.763244:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.763252:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f4e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263271.763257:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.763265:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.763283:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff994352cd3700) 00010000:00010000:0.0:1788263271.763285:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263271.763290:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.763296:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955caa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263271.763854:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.763937:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735857280 00000100:00100000:2.0:1788263271.763947:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735857280 00000100:00100000:2.0:1788263271.764005:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788263271.764016:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+9:9681:x1875129735857280:12345-192.168.201.29@tcp:36:touch.500 00010000:00010000:2.0:1788263271.764080:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263271.764101:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955cb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ff6 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.764115:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:2.0:1788263271.764134:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263271.764186:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.764201:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.764212:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263271.764385:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cde1f952 reply state 000000002d6bd623 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263271.764394:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263271.764479:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+10:9681:x1875129735857280:12345-192.168.201.29@tcp:36:touch.500 Request processed in 464us (627us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788263271.764486:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00010000:00010000:2.0:1788263271.766023:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.766038:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.766046:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.766052:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263271.766057:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.766064:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.766079:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99434314f600) 00010000:00010000:2.0:1788263271.766082:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263271.766086:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.766093:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263271.767580:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263271.767668:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735857408 00000100:00100000:3.0:1788263271.767677:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735857408 00000100:00100000:3.0:1788263271.767731:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:3.0:1788263271.767743:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+9:9681:x1875129735857408:12345-192.168.201.29@tcp:101:touch.500 00010000:00010000:3.0:1788263271.767769:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263271.767791:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4000/0x1a657bc513955cc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d2ffd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.767849:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4000/0x1a657bc513955cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ffd expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.767863:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4000/0x1a657bc513955cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ffd expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.767935:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:3.0:1788263271.767938:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263271.767942:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943821f4000, rc 0) 00000100:00100000:3.0:1788263271.768004:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+10:9681:x1875129735857408:12345-192.168.201.29@tcp:101:touch.500 Request processed in 263us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263271.768011:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:1.0:1788263271.771890:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.772352:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735857536 00000100:00100000:2.0:1788263271.772363:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735857536 00000100:00100000:2.0:1788263271.772444:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1788263271.772453:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875129735857536:12345-192.168.201.29@tcp:8:touch.500 00010000:00080000:2.0:1788263271.772485:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:2.0:1788263271.772523:0:6705:0:(genops.c:1385:class_connect()) connect: client fedef325-db54-4469-b29a-301ff58466df, cookie 0x1a657bc513955ccd 00002000:00100000:2.0:1788263271.772536:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fedef325-db54-4469-b29a-301ff58466df/ffff99437fa2c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788263271.772571:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788263271.772799:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788263271.772831:0:6705:0:(import.c:65:import_set_state_nolock()) ffff99437fa2e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263271.772908:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+6:2358:x1875129735857536:12345-192.168.201.29@tcp:8:touch.500 Request processed in 454us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.772917:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788263271.775314:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.776271:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735857664 00000100:00100000:2.0:1788263271.776287:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735857664 00000100:00100000:2.0:1788263271.776379:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1788263271.776394:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:0:x1875129735857664:12345-192.168.201.29@tcp:2:touch.500 00000100:00080000:1.0:1788263271.776748:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788263271.838655:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1788263271.838674:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000100:00100000:0.0:1788263271.838863:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:0:x1875129735857664:12345-192.168.201.29@tcp:2:touch.500 Request processed in 62467us (63552us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788263271.838876:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788263271.842029:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.842265:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735857920 00000100:00100000:2.0:1788263271.842276:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735857920 00000100:00100000:2.0:1788263271.842326:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788263271.842337:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+10:9681:x1875129735857920:12345-192.168.201.29@tcp:35:touch.500 00000100:00100000:2.0:1788263271.842697:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+11:9681:x1875129735857920:12345-192.168.201.29@tcp:35:touch.500 Request processed in 361us (676us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788263271.842705:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1788263271.864205:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.864759:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735858048 00000100:00100000:2.0:1788263271.864769:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735858048 00000100:00100000:2.0:1788263271.864870:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1788263271.864882:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+11:9682:x1875129735858048:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:2.0:1788263271.864907:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263271.864930:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3004 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.865029:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955cdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.865052:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.865064:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263271.865096:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263271.865100:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263271.865136:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.865161:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513955cd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3004 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.865178:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955cdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3004 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.865187:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263271.865190:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263271.865193:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6600, rc 0) 00000100:00100000:2.0:1788263271.865329:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+12:9682:x1875129735858048:12345-192.168.201.29@tcp:101:rm.0 Request processed in 448us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.865337:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:3.0:1788263271.869437:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263271.870356:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735858304 00000100:00100000:1.0:1788263271.870366:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735858304 00000100:00100000:1.0:1788263271.870420:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1788263271.870431:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+12:9682:x1875129735858304:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:1.0:1788263271.870452:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263271.870486:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ce2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d300b expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263271.871793:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788263271.871930:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ce2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d300b expref: 14 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.871945:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cabe00) 00010000:00010000:1.0:1788263271.871948:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263271.871953:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ce2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d300b expref: 14 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.871968:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158000, rc 0) 00000100:00100000:1.0:1788263271.872416:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+13:9682:x1875129735858304:12345-192.168.201.29@tcp:101:rm.0 Request processed in 1984us (2987us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788263271.872424:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:0.0:1788263271.878876:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.878944:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735858432 00000100:00100000:2.0:1788263271.878953:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735858432 00000100:00100000:2.0:1788263271.879022:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788263271.879032:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+13:9682:x1875129735858432:12345-192.168.201.29@tcp:37:rm.0 00000100:00100000:2.0:1788263271.886057:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+13:9682:x1875129735858432:12345-192.168.201.29@tcp:37:rm.0 Request processed in 7002us (7166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.886072:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1788263271.891460:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263271.891728:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735858688 00000100:00100000:0.0:1788263271.891739:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735858688 00000100:00100000:0.0:1788263271.891802:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1788263271.891813:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+13:9682:x1875129735858688:12345-192.168.201.29@tcp:35:rm.0 00000100:00100000:0.0:1788263271.892850:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+14:9682:x1875129735858688:12345-192.168.201.29@tcp:35:rm.0 Request processed in 1032us (1391us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788263271.892861:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1788263271.898159:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263271.898403:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735858944 00000100:00100000:1.0:1788263271.898414:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735858944 00000100:00100000:1.0:1788263271.898655:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:1.0:1788263271.898671:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+14:9682:x1875129735858944:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:1.0:1788263271.898697:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263271.898718:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955cf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3012 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.898823:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955cf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.898838:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.898865:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263271.898878:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788263271.899079:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955cf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3012 expref: 17 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.899098:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3012 expref: 16 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.899108:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263271.899111:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788263271.899115:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158000, rc 0) 00000100:00100000:1.0:1788263271.899197:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+16:9682:x1875129735858944:12345-192.168.201.29@tcp:101:rm.0 Request processed in 529us (1048us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788263271.899205:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1788263271.902278:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.902366:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735859072 00000100:00100000:2.0:1788263271.902377:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735859072 00000100:00100000:2.0:1788263271.902442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:2.0:1788263271.902453:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+16:9682:x1875129735859072:12345-192.168.201.29@tcp:41:rm.0 00000004:00000024:2.0:1788263271.902510:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788263271.902737:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+16:9682:x1875129735859072:12345-192.168.201.29@tcp:41:rm.0 Request processed in 285us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.902745:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:0.0:1788263271.904879:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263271.904956:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735859200 00000100:00100000:3.0:1788263271.904964:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735859200 00000100:00100000:3.0:1788263271.905014:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:3.0:1788263271.905023:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+16:9682:x1875129735859200:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:3.0:1788263271.905043:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263271.905062:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955d05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3019 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905121:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905135:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905147:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905160:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905187:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905195:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905441:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955d1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905450:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905458:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263271.905487:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788263271.905491:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263271.905512:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905704:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905715:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905720:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905727:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905742:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f4e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263271.905747:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905755:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905767:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263271.905770:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263271.905775:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905781:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4e00/0x1a657bc513955d0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905795:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905801:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905807:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905812:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f4600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263271.905815:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905821:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905840:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff994352cd3d00) 00010000:00010000:3.0:1788263271.905842:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263271.905844:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905850:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4600/0x1a657bc513955d13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905883:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f5600/0x1a657bc513955d05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3019 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905896:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3019 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263271.905904:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:3.0:1788263271.905906:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263271.905909:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ca00, rc 0) 00000100:00100000:3.0:1788263271.906069:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+17:9682:x1875129735859200:12345-192.168.201.29@tcp:101:rm.0 Request processed in 1045us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263271.906077:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788263271.909607:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263271.909788:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735859456 00000100:00100000:0.0:1788263271.909798:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735859456 00000100:00100000:0.0:1788263271.909857:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:0.0:1788263271.909868:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+17:9682:x1875129735859456:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:0.0:1788263271.909928:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788263271.909962:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513955d1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3019 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.909984:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943821f4000/0x1a657bc513955cc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2ffd expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910016:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:0.0:1788263271.910035:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513955cdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3004 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910044:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:0.0:1788263271.910048:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263271.910069:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910083:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910092:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910107:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910114:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910120:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910307:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910314:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.910330:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263271.911921:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788263271.911936:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298699718030ns, next at 299699715160ns, rc = 0 00010000:00010000:0.0:1788263271.912032:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912045:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912055:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912063:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912070:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912076:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912194:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263271.912253:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912261:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912267:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912282:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263271.912288:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912295:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912308:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994344cab600) 00010000:00010000:0.0:1788263271.912311:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788263271.912315:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912320:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955d2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912338:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912344:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912350:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912354:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263271.912356:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912361:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912381:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:0.0:1788263271.912383:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263271.912386:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263271.912391:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955d21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263271.912400:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000348961e1 reply state 0000000088d48b2a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263271.912409:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263271.912512:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+16:9682:x1875129735859456:12345-192.168.201.29@tcp:36:rm.0 Request processed in 2641us (2912us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788263271.912522:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:0.0:1788263271.916285:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263271.916591:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735859712 00000100:00100000:3.0:1788263271.916601:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735859712 00000100:00100000:3.0:1788263271.916664:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263271.916675:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+16:9682:x1875129735859712:12345-192.168.201.29@tcp:35:rm.0 00000100:00100000:3.0:1788263271.916914:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+17:9682:x1875129735859712:12345-192.168.201.29@tcp:35:rm.0 Request processed in 239us (640us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788263271.916921:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00010000:00010000:2.0:1788263271.917383:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.917395:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.917402:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.917408:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263271.917413:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.917421:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.917444:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff994344caba00) 00010000:00010000:2.0:1788263271.917447:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263271.917452:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.917459:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513955d28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.920642:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263271.920659:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.920671:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263271.920675:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.920686:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.920706:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff994344cab600) 00010000:00010000:1.0:1788263271.920727:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263271.920733:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.920738:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513955d36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.920764:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263271.920766:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263271.920768:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263271.923651:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263271.923735:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735859968 00000100:00100000:2.0:1788263271.923746:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735859968 00000100:00100000:2.0:1788263271.923803:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:2.0:1788263271.923812:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+16:9682:x1875129735859968:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:2.0:1788263271.923871:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788263271.923899:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955cf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3012 expref: 16 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.923921:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513955c95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fef expref: 15 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.923933:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263271.923948:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955c56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fe1 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.923956:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cabe00) 00010000:00010000:2.0:1788263271.923963:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263271.923996:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924024:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924034:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924047:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924056:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924062:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924325:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924334:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924341:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263271.924830:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788263271.924847:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924854:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924862:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924874:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263271.924878:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924886:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924896:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99434314fe00) 00010000:00010000:2.0:1788263271.924899:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788263271.924902:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924908:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955d4b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924928:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924933:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924939:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924943:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263271.924946:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924950:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924967:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99434314f700) 00010000:00010000:2.0:1788263271.924969:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263271.924972:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263271.924978:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955d3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263271.924989:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fd35a96 reply state 00000000a07a2dc5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263271.924998:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263271.925078:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+15:9682:x1875129735859968:12345-192.168.201.29@tcp:36:rm.0 Request processed in 1265us (1434us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788263271.925087:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00010000:00010000:1.0:1788263271.930736:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.930753:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.930761:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.930767:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263271.930772:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.930779:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.930798:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99434314f600) 00010000:00010000:1.0:1788263271.930801:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263271.930805:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263271.930811:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955d44 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263272.189689:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753715968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263272.189797:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263272.194412:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753715968 00000100:00100000:0.0:1788263272.194429:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753715968 00000100:00100000:0.0:1788263272.194507:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263272.194518:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753715968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263272.194545:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263272.194656:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753715968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (4858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263272.194663:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788263272.194763:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994375bd3480 x1875129753715968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263272.194784:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753715968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263272.635370:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263273.659451:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263273.710014:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263273.710062:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263273.710104:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263273.710157:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263273.710195:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735860096 00000100:00100000:0.0:1788263273.710205:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735860096 00000100:00100000:0.0:1788263273.710280:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 241 00000100:00100000:0.0:1788263273.710291:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735860096:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263273.710364:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735860096:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263273.710372:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 241 00000100:00100000:0.0:1788263273.710405:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735860352 00000100:00100000:0.0:1788263273.710409:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735860352 00000100:00100000:0.0:1788263273.710445:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:0.0:1788263273.710453:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735860352:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263273.710483:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735860352:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263273.710489:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00080000:0.0:1788263273.710620:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263273.710702:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735860224 00000100:00100000:2.0:1788263273.710708:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735860224 00000100:00100000:2.0:1788263273.710755:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735860480 00000100:00100000:2.0:1788263273.710759:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735860480 00000100:00100000:2.0:1788263273.710781:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:2.0:1788263273.710787:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+14:2361:x1875129735860224:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263273.710828:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+14:2361:x1875129735860224:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 41us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.710834:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:2.0:1788263273.710847:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:2.0:1788263273.710853:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735860480:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263273.710876:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735860480:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.710889:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00080000:0.0:1788263273.711112:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788263274.685023:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263275.710105:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788263276.029912:0:11636:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788263276.286428:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753716224:0@lo:400:kworker.0 00000100:00100000:0.0:1788263276.286503:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263276.286566:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753716736:0@lo:400:kworker.0 00000100:00100000:0.0:1788263276.286593:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263276.286625:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263276.286631:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753716352:0@lo:400:kworker.0 00000100:00100000:0.0:1788263276.286653:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263276.286687:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753716224 00000100:00100000:0.0:1788263276.286701:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753716224 00000100:00100000:0.0:1788263276.286744:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753716352 00000100:00100000:0.0:1788263276.286747:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753716352 00000100:00100000:0.0:1788263276.286780:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788263276.286788:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753716224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263276.286838:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753716224:12345-0@lo:400:kworker.0 Request processed in 50us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263276.286845:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788263276.286862:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788263276.286868:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753716352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263276.286894:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753716352:12345-0@lo:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263276.286900:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788263276.287000:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753716736 00000100:00100000:0.0:1788263276.287004:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753716736 00000100:00100000:0.0:1788263276.287034:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788263276.287041:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753716736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263276.287071:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753716736:12345-0@lo:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263276.287077:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788263276.287100:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263276.287105:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263276.287138:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753716352:0@lo:400:kworker.0 00000100:00100000:0.0:1788263276.287148:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753716224:0@lo:400:kworker.0 00010000:00080000:0.0:1788263276.287159:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943810dbb80 x1875129753716736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263276.287181:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753716736:0@lo:400:kworker.0 00000100:00100000:3.0:1788263276.287302:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753716480:0@lo:400:kworker.0 00000100:00100000:3.0:1788263276.287333:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263276.287350:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788263276.287356:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753716096:0@lo:400:kworker.0 00000100:00100000:3.0:1788263276.287381:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263276.287404:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753716608:0@lo:400:kworker.0 00000100:00100000:3.0:1788263276.287427:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263276.287453:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753716096 00000100:00100000:3.0:1788263276.287457:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753716096 00000100:00100000:3.0:1788263276.287485:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788263276.287492:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753716096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263276.287525:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753716096:12345-0@lo:400:kworker.0 Request processed in 33us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263276.287531:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788263276.287577:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753716096:0@lo:400:kworker.0 00000100:00100000:3.0:1788263276.287593:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753716608 00000100:00100000:3.0:1788263276.287596:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753716608 00000100:00100000:3.0:1788263276.287623:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788263276.287629:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753716608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263276.287662:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753716608:12345-0@lo:400:kworker.0 Request processed in 33us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263276.287669:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788263276.287693:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753716608:0@lo:400:kworker.0 00000100:00080000:3.0:1788263276.287716:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263276.291182:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753716480 00000100:00100000:0.0:1788263276.291195:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753716480 00000100:00100000:0.0:1788263276.291291:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263276.291301:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753716480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263276.291395:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753716480:12345-0@lo:400:kworker.0 Request processed in 96us (4061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263276.291403:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788263276.291641:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943810d9f80 x1875129753716480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263276.291659:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753716480:0@lo:400:kworker.0 00000100:00080000:2.0:1788263276.292645:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788263276.731746:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263276.796841:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753716864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263276.796934:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263276.797002:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753716864 00000100:00100000:1.0:1788263276.797010:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753716864 00000100:00100000:1.0:1788263276.797064:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788263276.797074:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753716864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263276.797107:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263276.797171:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753716864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263276.797178:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788263276.797257:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437fd70380 x1875129753716864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263276.797275:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753716864:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788263276.912784:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1788263276.912799:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788263276.912833:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1788263276.913023:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263276.913113:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753716992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788263276.913184:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263276.913343:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753716992 00000100:00100000:0.0:1788263276.913351:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753716992 00000100:00100000:0.0:1788263276.913403:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788263276.913413:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753716992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788263276.913438:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788263276.913470:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a96bb67, atime: 0x6a96bb67, ctime: 0x6a96bb67, blocks: 0x1 00010000:00010000:0.0:1788263276.913478:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263276.913494:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=303s v=(0 0) 00010000:00010000:0.0:1788263276.913507:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263276.913514:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263276.913531:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263276.913551:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263276.913560:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263276.913648:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788263276.914186:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753716992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 772us (1000us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788263276.914195:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788263276.914292:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263276.914301:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263276.914310:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263276.914315:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263276.914324:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263276.914344:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263276.914351:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513955d52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263276.914370:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263276.914372:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263276.914373:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788263276.914516:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9943810d8380/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788263276.914524:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753716992:0@lo:6:osp-syn-0-0.0 00000020:00000080:1.0:1788263277.100392:0:11685:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe59e19c20 20000000:00000080:1.0:1788263277.100411:0:11685:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99437fa1e000 uarg=0000000000000000 20000000:01000000:1.0:1788263277.100446:0:11685:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788263277.100461:0:11685:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788263277.100467:0:11685:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788263277.101408:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788263277.101661:0:11685:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788263277.109518:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788263277.109711:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788263277.109775:0:11685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788263277.109793:0:11685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788263277.109815:0:11685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.109836:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fcc expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.109845:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fd3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.109866:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955c02 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.109873:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955c10 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.109880:0:11685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955c1e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.109886:0:11685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.109927:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955c1e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.109943:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955c1e expref: 18 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.109957:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717120:0@lo:104: 00000100:00100000:0.0:1788263277.110030:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263277.110152:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955c10 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.110161:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955c10 expref: 18 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.110169:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717248:0@lo:104: 00000100:00100000:0.0:1788263277.110191:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263277.110491:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513955c02 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.110507:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513955c02 expref: 18 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.110515:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717376:0@lo:104: 00000100:00100000:0.0:1788263277.110553:0:11685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263277.110759:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753717120 00000100:00100000:2.0:1788263277.110767:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753717120 00000100:00100000:2.0:1788263277.110807:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753717248 00000100:00100000:2.0:1788263277.110811:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753717248 00000100:00100000:2.0:1788263277.110836:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263277.110845:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:11685:x1875129753717120:12345-0@lo:104: 00010000:00010000:2.0:1788263277.110858:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.110918:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263277.110924:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+4:11685:x1875129753717120:12345-0@lo:104: Request processed in 80us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263277.110929:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263277.110946:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263277.110952:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:11685:x1875129753717248:12345-0@lo:104: 00010000:00010000:2.0:1788263277.110959:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.110988:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788263277.110992:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:11685:x1875129753717248:12345-0@lo:104: Request processed in 41us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263277.110997:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788263277.111015:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788263277.111020:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111027:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159600 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263277.111032:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111042:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263277.111060:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263277.111066:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788263277.111094:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111101:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263277.111121:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111128:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc513955c1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955c25 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111142:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263277.111145:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111150:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943821f5c00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263277.111152:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111158:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263277.111164:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263277.111169:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788263277.111186:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111192:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263277.111210:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111244:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943821f5c00/0x1a657bc513955c10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955c17 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.111254:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263277.111256:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263277.111257:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263277.111265:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263277.111277:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753717504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263277.111307:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263277.111390:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263277.111673:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753717632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263277.111699:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263277.111744:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753717504 00000100:00100000:0.0:1788263277.111749:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753717504 00010000:00010000:0.0:1788263277.111769:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955c1e expref: 19 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.111789:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753717632 00000100:00100000:0.0:1788263277.111792:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753717632 00010000:00010000:0.0:1788263277.111802:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955c10 expref: 20 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.111815:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263277.111821:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+20:3322:x1875129753717504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263277.111832:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263277.111836:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955c1e expref: 20 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.111846:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955c1e expref: 20 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.111863:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263277.111892:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+20:3322:x1875129753717504:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263277.111906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263277.111921:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263277.111927:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753717632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263277.111935:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263277.111939:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955c10 expref: 19 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.111947:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955c10 expref: 19 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.111956:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263277.111981:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753717632:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263277.111987:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263277.112020:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753717632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263277.112045:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753717504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263277.112075:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fd3 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.112088:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fd3 expref: 12 pid: 5846 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.112098:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717760:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263277.112730:0:11685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fcc expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.112741:0:11685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fcc expref: 12 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.112757:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717888:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263277.112812:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788263277.112828:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994382042c00/0x1a657bc513955c25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955c1e expref: 18 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.112842:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717120:0@lo:104: 00010000:00010000:0.0:1788263277.112851:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994382042400/0x1a657bc513955c17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955c10 expref: 17 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.112859:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717248:0@lo:104: 00000100:00100000:3.0:1788263277.113026:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753717376 00000100:00100000:3.0:1788263277.113032:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753717376 00000100:00100000:2.0:1788263277.113380:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788263277.113398:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263277.113423:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:11685:x1875129753717376:12345-0@lo:104: 00010000:00010000:2.0:1788263277.113444:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263277.114019:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263277.114027:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33366ce6-2c46-49eb-9afc-8617712bc2f4+3:11685:x1875129753717376:12345-0@lo:104: Request processed in 607us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263277.114035:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788263277.114190:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263277.114197:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263277.114205:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382043a00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:3.0:1788263277.114209:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263277.114243:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263277.114251:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263277.114257:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788263277.114291:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263277.114297:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263277.114318:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263277.114325:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994382043a00/0x1a657bc513955c02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513955c09 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263277.114355:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263277.114357:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263277.114358:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263277.114373:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753718016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263277.114415:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263277.114843:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753718016 00000100:00100000:1.0:1788263277.114849:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753718016 00010000:00010000:1.0:1788263277.114873:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955c02 expref: 17 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263277.114905:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263277.114913:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3321:x1875129753718016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263277.114925:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263277.114930:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513955c02 expref: 17 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263277.114941:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513955c02 expref: 17 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263277.114958:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263277.114995:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc91450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3321:x1875129753718016:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263277.115002:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788263277.115275:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753718016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263277.115379:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f4400/0x1a657bc513955c09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513955c02 expref: 16 pid: 5847 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.115393:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717376:0@lo:104: 00000100:00100000:0.0:1788263277.115408:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717760:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263277.115416:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11685:1875129753717888:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263277.115526:0:11685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.119555:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263277.119638:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263277.119806:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735860608 00000100:00100000:2.0:1788263277.119815:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735860608 00010000:00010000:2.0:1788263277.119855:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fd3 expref: 13 pid: 5846 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263277.119913:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735860736 00000100:00100000:2.0:1788263277.119917:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735860736 00010000:00010000:2.0:1788263277.119930:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fcc expref: 14 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.120021:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:0.0:1788263277.120032:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b18c11e-0696-4540-97e4-82aaa1c0495b+14:2362:x1875129735860608:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263277.120049:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263277.120056:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fd3 expref: 14 pid: 5846 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120076:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fd3 expref: 14 pid: 5846 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120093:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994382042200/0x1a657bc513955bfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fd3 expref: 14 pid: 5846 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120110:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263277.120164:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2362:x1875129735860608:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 134us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263277.120172:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:0.0:1788263277.120192:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:0.0:1788263277.120199:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:2362:x1875129735860736:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263277.120207:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263277.120211:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fcc expref: 12 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120246:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fcc expref: 12 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120256:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f5000/0x1a657bc513955bf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2fcc expref: 12 pid: 5844 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120267:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120275:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120298:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120306:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120313:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120320:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120325:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263277.120329:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120337:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120349:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120358:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263277.120374:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:2362:x1875129735860736:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 176us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263277.120380:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00010000:00010000:0.0:1788263277.120902:0:11685:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120912:0:11685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263277.120925:0:11685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380658a00/0x1a657bc513955d59 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263277.307820:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263277.307844:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753718144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263277.307921:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263277.307986:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753718144 00000100:00100000:0.0:1788263277.307994:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753718144 00000100:00100000:0.0:1788263277.308040:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263277.308049:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753718144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263277.308083:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263277.308127:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753718144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263277.308134:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263277.308178:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753718144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263277.755741:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788263278.267704:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263278.267715:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994375782000 from 7 10000000:01000000:2.0:1788263278.267721:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263278.267777:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.267789:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.267800:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263278.267828:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753718272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263278.267907:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.267997:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263278.268132:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753718272 00000100:00100000:0.0:1788263278.268140:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753718272 00000100:00100000:0.0:1788263278.268203:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788263278.268213:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:5849:x1875129753718272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263278.268251:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263278.268266:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994380658000/0x1a657bc513955d67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955d60 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263278.268287:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380658000/0x1a657bc513955d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955d60 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263278.268297:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994380658000/0x1a657bc513955d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955d60 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263278.268319:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658000, rc 0) 00000100:00100000:0.0:1788263278.268374:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753718272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.268380:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788263278.268472:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753718272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263278.268487:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.268496:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263278.268555:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753718400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263278.268592:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.268622:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263278.268678:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753718400 00000100:00100000:3.0:1788263278.268683:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753718400 00000100:00100000:3.0:1788263278.268716:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788263278.268724:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753718400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263278.268979:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753718400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.268987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788263278.269065:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753718400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.269094:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753718528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.269130:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263278.269156:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330780 going to sleep for 11 seconds 00000100:00100000:1.0:1788263278.269238:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753718528 00000100:00100000:1.0:1788263278.269244:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753718528 00000100:00100000:1.0:1788263278.269279:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788263278.269288:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753718528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263278.269439:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753718528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263278.269455:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788263278.269575:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753718528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.270095:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11699:1875129753718656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263278.270138:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263278.270173:0:11699:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263278.270354:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753718656 00000100:00100000:1.0:1788263278.270360:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753718656 00000100:00100000:1.0:1788263278.270397:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788263278.270404:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:11699:x1875129753718656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263278.270571:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:11699:x1875129753718656:12345-0@lo:502:llog_process_th.0 Request processed in 167us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263278.270578:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788263278.270701:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11699:1875129753718656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263278.270728:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263278.270738:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263278.270741:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788263278.270747:0:11699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994375782000 00000020:00000080:0.0:1788263278.270749:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788263278.270833:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11699:1875129753718784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263278.270866:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263278.270896:0:11699:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330300 going to sleep for 11 seconds 00000100:00100000:2.0:1788263278.270957:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753718784 00000100:00100000:2.0:1788263278.270962:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753718784 00000100:00100000:2.0:1788263278.270997:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788263278.271005:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:11699:x1875129753718784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263278.271149:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:11699:x1875129753718784:12345-0@lo:502:llog_process_th.0 Request processed in 145us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263278.271155:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788263278.271259:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11699:1875129753718784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788263278.271278:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263278.271283:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263278.271285:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788263278.271289:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788263278.271474:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788263278.271493:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263278.271503:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.271522:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263278.271533:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263278.271536:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99438144e800 from 7 10000000:01000000:2.0:1788263278.271539:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263278.271563:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.271570:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.271577:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263278.271591:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753718912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263278.271627:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.271657:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263278.271702:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753718912 00000100:00100000:3.0:1788263278.271706:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753718912 00000100:00100000:3.0:1788263278.271746:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788263278.271753:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:5849:x1875129753718912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263278.271762:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263278.271775:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216c200/0x1a657bc513955d75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955d6e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.271807:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216c200/0x1a657bc513955d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955d6e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.271817:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216c200/0x1a657bc513955d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955d6e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.271825:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216c200, rc 0) 00000100:00100000:3.0:1788263278.271860:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753718912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.271865:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788263278.271946:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753718912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263278.271959:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263278.271973:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263278.272016:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.272040:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263278.272064:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263278.276108:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753719040 00000100:00100000:3.0:1788263278.276123:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753719040 00000100:00100000:3.0:1788263278.276192:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788263278.276203:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753719040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263278.276509:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753719040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (4466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.276528:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788263278.276914:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.276974:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.277018:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263278.277059:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263278.277138:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753719168 00000100:00100000:2.0:1788263278.277143:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753719168 00000100:00100000:2.0:1788263278.277183:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788263278.277192:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753719168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263278.277374:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753719168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263278.277382:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788263278.277420:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263278.278304:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11701:1875129753719296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263278.278351:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.278380:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263278.278443:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753719296 00000100:00100000:3.0:1788263278.278448:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753719296 00000100:00100000:3.0:1788263278.278477:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788263278.278484:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:11701:x1875129753719296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263278.278646:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:11701:x1875129753719296:12345-0@lo:502:llog_process_th.0 Request processed in 161us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.278652:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788263278.279108:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11701:1875129753719296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263278.279140:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263278.279151:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263278.279153:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788263278.279160:0:11701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99438144e800 00000020:00000080:2.0:1788263278.279162:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788263278.279273:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11701:1875129753719424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263278.279313:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.279335:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263278.279403:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753719424 00000100:00100000:0.0:1788263278.279409:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753719424 00000100:00100000:0.0:1788263278.279447:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788263278.279455:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:11701:x1875129753719424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263278.279600:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:11701:x1875129753719424:12345-0@lo:502:llog_process_th.0 Request processed in 146us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.279607:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788263278.280184:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11701:1875129753719424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263278.280207:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263278.280212:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263278.280246:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788263278.280250:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788263278.280403:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788263278.280427:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263278.280437:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263278.280448:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263278.280469:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263278.280472:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994350979800 from 7 10000000:01000000:0.0:1788263278.280475:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263278.280506:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263278.280522:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263278.280531:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263278.280547:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.280586:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263278.280616:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263278.280676:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753719552 00000100:00100000:3.0:1788263278.280682:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753719552 00000100:00100000:3.0:1788263278.280724:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788263278.280732:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:5849:x1875129753719552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263278.280742:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263278.280753:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d400/0x1a657bc513955d83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513955d7c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.280775:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d400/0x1a657bc513955d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513955d7c expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.280786:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d400/0x1a657bc513955d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513955d7c expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.280794:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d400, rc 0) 00000100:00100000:3.0:1788263278.280839:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753719552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.280845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788263278.282801:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263278.282828:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.282841:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263278.282918:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263278.282974:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.283013:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263278.283115:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753719680 00000100:00100000:0.0:1788263278.283122:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753719680 00000100:00100000:0.0:1788263278.283169:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788263278.283179:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753719680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.283447:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753719680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.283455:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788263278.288659:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263278.288738:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263278.288820:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.288865:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263278.288993:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753719808 00000100:00100000:0.0:1788263278.289001:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753719808 00000100:00100000:0.0:1788263278.289057:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788263278.289067:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434a27a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753719808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.289280:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434a27a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:5849:x1875129753719808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.289295:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788263278.289620:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33366ce6-2c46-49eb-9afc-8617712bc2f4:5849:1875129753719808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263278.289973:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11702:1875129753719936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263278.290013:0:11702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.290046:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263278.290093:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753719936 00000100:00100000:3.0:1788263278.290098:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753719936 00000100:00100000:3.0:1788263278.290137:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788263278.290145:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:11702:x1875129753719936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263278.290338:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:11702:x1875129753719936:12345-0@lo:502:llog_process_th.0 Request processed in 194us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.290346:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788263278.291346:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11702:1875129753719936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263278.291381:0:11702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263278.291394:0:11702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263278.291396:0:11702:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788263278.291404:0:11702:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994350979800 00000020:00000080:2.0:1788263278.291406:0:11702:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788263278.291487:0:11702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11702:1875129753720064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263278.291546:0:11702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.291574:0:11702:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263278.293317:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753720064 00000100:00100000:3.0:1788263278.293330:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753720064 00000100:00100000:3.0:1788263278.293385:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788263278.293396:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:11702:x1875129753720064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263278.293662:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:11702:x1875129753720064:12345-0@lo:502:llog_process_th.0 Request processed in 267us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.293676:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788263278.297741:0:11702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33366ce6-2c46-49eb-9afc-8617712bc2f4:11702:1875129753720064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263278.297791:0:11702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263278.297800:0:11702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263278.297802:0:11702:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788263278.297807:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788263278.298199:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788263278.298245:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263278.298258:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.298270:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263278.309953:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788263278.790991:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263278.825931:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263278.825976:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263278.826003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263278.826039:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263278.826065:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263278.826155:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735861120 00000100:00100000:0.0:1788263278.826166:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735861120 00000100:00100000:0.0:1788263278.826265:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735861376 00000100:00100000:0.0:1788263278.826269:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735861376 00000100:00100000:0.0:1788263278.826291:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:0.0:1788263278.826301:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735861120:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263278.826374:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735861120:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 73us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.826381:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:0.0:1788263278.826398:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:0.0:1788263278.826418:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735861376:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263278.826443:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735861376:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 40us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.826449:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:0.0:1788263278.826469:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735861248 00000100:00100000:0.0:1788263278.826472:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735861248 00000100:00100000:0.0:1788263278.826499:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:0.0:1788263278.826519:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735861248:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263278.826670:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735861248:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 164us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.826676:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00080000:1.0:1788263278.827440:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263278.827447:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263278.827761:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735860864 00000100:00100000:3.0:1788263278.827769:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735860864 00000100:00100000:3.0:1788263278.827811:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735860992 00000100:00100000:3.0:1788263278.827814:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735860992 00000100:00100000:3.0:1788263278.827831:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 258 00000100:00100000:3.0:1788263278.827839:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735860864:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263278.827853:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263278.827869:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216c000/0x1a657bc513955d8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3020 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.827894:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216c000/0x1a657bc513955d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3020 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.827906:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216c000/0x1a657bc513955d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3020 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263278.827915:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216c000, rc 0) 00000100:00100000:3.0:1788263278.827968:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735860864:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 129us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.827987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 258 00000100:00100000:3.0:1788263278.828013:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 259 00000100:00100000:3.0:1788263278.828019:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994350923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:2361:x1875129735860992:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263278.828040:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994350923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:2361:x1875129735860992:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 21us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.828046:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 259 00000100:00100000:1.0:1788263278.834375:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263278.834472:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735861504 00000100:00100000:3.0:1788263278.834481:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735861504 00000100:00100000:3.0:1788263278.834583:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 260 00000100:00100000:3.0:1788263278.834594:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735861504:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263278.834893:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735861504:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 300us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.834901:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 260 00000100:00100000:1.0:1788263278.842536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263278.848302:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735861632 00000100:00100000:0.0:1788263278.848318:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735861632 00000100:00100000:0.0:1788263278.848427:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 261 00000100:00100000:0.0:1788263278.848438:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735861632:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.849052:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735861632:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 613us (6523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.849061:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 261 00000100:00100000:0.0:1788263278.862955:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263278.869267:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735861760 00000100:00100000:2.0:1788263278.869282:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735861760 00000100:00100000:2.0:1788263278.869658:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 262 00000100:00100000:2.0:1788263278.869670:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:9952:x1875129735861760:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263278.869953:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:9952:x1875129735861760:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 284us (7005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263278.869961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 262 00000100:00100000:1.0:1788263278.881158:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263278.881358:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735861888 00000100:00100000:0.0:1788263278.881369:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735861888 00000100:00100000:0.0:1788263278.881662:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 263 00000100:00100000:0.0:1788263278.881675:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:9952:x1875129735861888:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263278.882038:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:9952:x1875129735861888:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 364us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.882047:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 263 00000100:00100000:1.0:1788263278.908812:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263278.908914:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735862016 00000100:00100000:2.0:1788263278.908926:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735862016 00000100:00100000:2.0:1788263278.908983:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 264 00000100:00100000:2.0:1788263278.908993:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:5599:x1875129735862016:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263278.909011:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263278.909030:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d7c00/0x1a657bc513955d91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3027 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.909060:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d7c00/0x1a657bc513955d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3027 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.909072:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d7c00/0x1a657bc513955d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3027 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263278.909082:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7c00, rc 0) 00000100:00100000:2.0:1788263278.909146:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735862016:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 154us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263278.909169:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 264 00000100:00100000:1.0:1788263278.916709:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263278.916964:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735862144 00000100:00100000:0.0:1788263278.916986:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735862144 00000100:00100000:0.0:1788263278.917045:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 265 00000100:00100000:0.0:1788263278.917056:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735862144:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263278.918201:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735862144:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 1138us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.918213:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 265 00000100:00100000:1.0:1788263278.920904:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263278.921078:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735862272 00000100:00100000:3.0:1788263278.921088:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735862272 00000100:00100000:3.0:1788263278.921193:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 266 00000100:00100000:3.0:1788263278.921204:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735862272:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263278.921478:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:5599:x1875129735862272:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 275us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.921484:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 266 00000100:00100000:1.0:1788263278.927822:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263278.928664:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735862400 00000100:00100000:0.0:1788263278.928678:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735862400 00000100:00100000:0.0:1788263278.928800:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 267 00000100:00100000:0.0:1788263278.928812:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:9955:x1875129735862400:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263278.929084:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:9955:x1875129735862400:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 273us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.929098:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 267 00000100:00100000:1.0:1788263278.932136:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263278.932304:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735862528 00000100:00100000:3.0:1788263278.932316:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735862528 00000100:00100000:3.0:1788263278.932436:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 268 00000100:00100000:3.0:1788263278.932448:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:9955:x1875129735862528:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263278.932735:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:9955:x1875129735862528:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 287us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263278.932744:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 268 00000040:00080000:0.0:1788263279.355937:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788263279.803724:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263280.827532:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263281.403760:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753720448:0@lo:400:kworker.0 00000100:00100000:3.0:1788263281.403837:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263281.403904:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788263281.403911:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753720320:0@lo:400:kworker.0 00000100:00100000:3.0:1788263281.403957:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263281.403978:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753720832:0@lo:400:kworker.0 00000100:00100000:3.0:1788263281.404005:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263281.404052:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753720448 00000100:00100000:3.0:1788263281.404059:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753720448 00000100:00100000:3.0:1788263281.404111:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753720320 00000100:00100000:3.0:1788263281.404115:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753720320 00000100:00100000:3.0:1788263281.404138:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788263281.404146:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753720448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263281.404196:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753720448:12345-0@lo:400:kworker.0 Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263281.404203:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788263281.404204:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753720832 00000100:00100000:2.0:1788263281.404208:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753720832 00000100:00100000:3.0:1788263281.404240:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788263281.404246:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753720320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263281.404257:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788263281.404263:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753720832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263281.404274:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753720320:12345-0@lo:400:kworker.0 Request processed in 28us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263281.404279:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788263281.404292:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753720832:12345-0@lo:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263281.404299:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788263281.404308:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263281.404313:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263281.404341:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753720320:0@lo:400:kworker.0 00010000:00080000:2.0:1788263281.404354:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437f6eb800 x1875129753720832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263281.404363:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753720832:0@lo:400:kworker.0 00000100:00100000:2.0:1788263281.404373:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753720448:0@lo:400:kworker.0 00000100:00100000:0.0:1788263281.404520:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753720192:0@lo:400:kworker.0 00000100:00100000:0.0:1788263281.404557:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263281.404589:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753720704:0@lo:400:kworker.0 00000100:00100000:0.0:1788263281.404623:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263281.404649:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263281.404655:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753720576:0@lo:400:kworker.0 00000100:00100000:0.0:1788263281.404677:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263281.404704:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753720704 00000100:00100000:0.0:1788263281.404708:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753720704 00000100:00100000:0.0:1788263281.404745:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788263281.404752:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753720704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263281.404788:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753720704:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263281.404794:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788263281.404812:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753720576 00000100:00100000:0.0:1788263281.404815:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753720576 00000100:00100000:0.0:1788263281.404838:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263281.404844:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753720576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263281.404872:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753720576:12345-0@lo:400:kworker.0 Request processed in 28us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263281.404878:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263281.404912:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753720576:0@lo:400:kworker.0 00000100:00100000:0.0:1788263281.404925:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753720704:0@lo:400:kworker.0 00000100:00080000:3.0:1788263281.405182:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263281.405186:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263281.405196:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753720192 00000100:00100000:3.0:1788263281.405200:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753720192 00000100:00100000:3.0:1788263281.405255:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788263281.405263:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753720192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263281.405306:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753720192:12345-0@lo:400:kworker.0 Request processed in 44us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263281.405312:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788263281.405478:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753720192:0@lo:400:kworker.0 00010000:00010000:1.0:1788263281.853310:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263281.917043:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753720960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263281.917128:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263281.917270:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753720960 00000100:00100000:1.0:1788263281.917280:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753720960 00000100:00100000:1.0:1788263281.917336:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788263281.917345:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753720960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263281.917381:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263281.917425:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753720960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263281.917431:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788263281.917530:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437fd73100 x1875129753720960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263281.917549:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753720960:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788263281.996909:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1788263282.427612:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263282.427638:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753721088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263282.427712:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263282.427824:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753721088 00000100:00100000:0.0:1788263282.427832:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753721088 00000100:00100000:0.0:1788263282.427882:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263282.427891:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753721088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263282.427925:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263282.427968:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753721088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263282.427975:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263282.428008:0:3323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788263282.428013:0:3323:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9943810d8380, transno 4294967300 00000100:00100000:0.0:1788263282.428027:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753721088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788263282.875526:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263283.899591:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263283.943894:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263283.943941:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263283.943954:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735862656 00000100:00100000:3.0:1788263283.943964:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735862656 00000100:00100000:3.0:1788263283.944030:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 270 00000100:00100000:3.0:1788263283.944041:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735862656:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263283.944124:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735862656:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263283.944131:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 270 00000100:00100000:0.0:1788263283.944684:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735862784 00000100:00100000:0.0:1788263283.944691:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735862784 00000100:00100000:0.0:1788263283.944786:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:0.0:1788263283.944794:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+5:2360:x1875129735862784:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263283.944840:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+5:2360:x1875129735862784:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 47us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263283.944847:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00080000:1.0:1788263283.949645:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263283.954042:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263283.954094:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263283.954118:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735863040 00000100:00100000:2.0:1788263283.954129:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735863040 00000100:00100000:2.0:1788263283.954214:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:2.0:1788263283.954256:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735863040:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:1.0:1788263283.954307:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263283.954388:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735863040:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 134us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263283.954396:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:3.0:1788263283.954497:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735862912 00000100:00100000:3.0:1788263283.954502:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735862912 00000100:00100000:3.0:1788263283.954546:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:3.0:1788263283.954569:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735862912:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263283.954598:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735862912:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263283.954604:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00080000:2.0:1788263283.954728:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788263284.925629:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263285.948563:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263286.524906:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753721216:0@lo:400:kworker.0 00000100:00100000:0.0:1788263286.524996:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263286.525077:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753721728:0@lo:400:kworker.0 00000100:00100000:0.0:1788263286.525105:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263286.525145:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263286.525166:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753721600:0@lo:400:kworker.0 00000100:00100000:0.0:1788263286.525196:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263286.525249:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753721728 00000100:00100000:0.0:1788263286.525257:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753721728 00000100:00100000:0.0:1788263286.525321:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788263286.525331:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753721728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263286.525396:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753721728:12345-0@lo:400:kworker.0 Request processed in 66us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263286.525404:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788263286.525428:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753721600 00000100:00100000:0.0:1788263286.525432:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753721600 00000100:00100000:0.0:1788263286.525461:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788263286.525468:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753721600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263286.525498:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753721600:12345-0@lo:400:kworker.0 Request processed in 30us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263286.525506:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788263286.525545:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753721600:0@lo:400:kworker.0 00000100:00100000:0.0:1788263286.525556:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753721728:0@lo:400:kworker.0 00000100:00100000:3.0:1788263286.526435:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753721344:0@lo:400:kworker.0 00000100:00100000:3.0:1788263286.526490:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263286.526530:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753721856:0@lo:400:kworker.0 00000100:00100000:3.0:1788263286.526556:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263286.526576:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263286.526582:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753721472:0@lo:400:kworker.0 00000100:00100000:3.0:1788263286.526602:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263286.526632:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753721856 00000100:00100000:3.0:1788263286.526636:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753721856 00000100:00100000:3.0:1788263286.526675:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788263286.526681:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753721856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263286.526712:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753721856:12345-0@lo:400:kworker.0 Request processed in 32us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263286.526716:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788263286.526739:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437fd72d80 x1875129753721856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263286.526748:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753721856:0@lo:400:kworker.0 00000100:00080000:2.0:1788263286.527623:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263286.527630:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263286.527634:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263286.527777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753721216 00000100:00100000:1.0:1788263286.527785:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753721216 00000100:00100000:1.0:1788263286.527834:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788263286.527843:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753721216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263286.527911:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753721216:12345-0@lo:400:kworker.0 Request processed in 69us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263286.527918:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788263286.528016:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753721344 00000100:00100000:0.0:1788263286.528021:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753721344 00000100:00100000:0.0:1788263286.528067:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753721472 00000100:00100000:0.0:1788263286.528070:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753721472 00000100:00100000:0.0:1788263286.528097:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788263286.528104:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753721344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263286.528155:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753721344:12345-0@lo:400:kworker.0 Request processed in 52us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263286.528162:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788263286.528190:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788263286.528196:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753721472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263286.528254:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753721472:12345-0@lo:400:kworker.0 Request processed in 58us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263286.528261:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1788263286.528876:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263286.528911:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753721216:0@lo:400:kworker.0 00000100:00100000:3.0:1788263286.529839:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753721472:0@lo:400:kworker.0 00000100:00100000:3.0:1788263286.529869:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753721344:0@lo:400:kworker.0 00010000:00010000:3.0:1788263286.971446:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263287.036278:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753721984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263287.036373:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263287.036562:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753721984 00000100:00100000:0.0:1788263287.036571:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753721984 00000100:00100000:0.0:1788263287.036623:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788263287.036634:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753721984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263287.036670:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263287.036727:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753721984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263287.036735:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788263287.036803:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437fd72300 x1875129753721984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263287.036821:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753721984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263287.552397:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753722112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263287.552474:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263287.552545:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753722112 00000100:00100000:0.0:1788263287.552552:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753722112 00000100:00100000:0.0:1788263287.552594:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263287.552603:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753722112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263287.552638:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263287.552679:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753722112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263287.552686:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263287.552737:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753722112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263287.996286:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263289.019541:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263289.060899:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263289.061398:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263289.061436:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263289.061574:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735863296 00000100:00100000:3.0:1788263289.061584:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735863296 00000100:00100000:3.0:1788263289.061646:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:3.0:1788263289.061656:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735863296:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263289.061728:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735863296:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 74us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263289.061736:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00080000:3.0:1788263289.061758:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263289.061783:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263289.062060:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735863168 00000100:00100000:0.0:1788263289.062066:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735863168 00000100:00100000:0.0:1788263289.062104:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 272 00000100:00100000:0.0:1788263289.062112:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2359:x1875129735863168:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263289.062161:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2359:x1875129735863168:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 50us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263289.062167:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 272 00000100:00100000:0.0:1788263289.062198:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735863424 00000100:00100000:0.0:1788263289.062202:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735863424 00000100:00100000:1.0:1788263289.062371:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735863552 00000100:00100000:1.0:1788263289.062375:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735863552 00000100:00100000:1.0:1788263289.062409:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:1.0:1788263289.062416:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735863552:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263289.062447:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735863552:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263289.062453:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00080000:1.0:1788263289.062484:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263289.062488:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263289.063245:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:0.0:1788263289.063256:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735863424:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263289.063296:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735863424:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 43us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263289.063304:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000040:00080000:0.0:1788263289.595883:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788263290.047397:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263291.070013:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263291.643788:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753722624:0@lo:400:kworker.0 00000100:00100000:1.0:1788263291.643865:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263291.643868:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753722368:0@lo:400:kworker.0 00000100:00100000:2.0:1788263291.643913:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263291.643928:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788263291.643936:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753722240:0@lo:400:kworker.0 00000100:00100000:2.0:1788263291.643940:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753722880:0@lo:400:kworker.0 00000100:00100000:1.0:1788263291.643980:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263291.643981:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263291.644014:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753722752:0@lo:400:kworker.0 00000100:00100000:2.0:1788263291.644017:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263291.644026:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753722496:0@lo:400:kworker.0 00000100:00100000:1.0:1788263291.644047:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263291.644076:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263291.644103:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753722368 00000100:00100000:1.0:1788263291.644111:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753722368 00000100:00100000:2.0:1788263291.644129:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753722752 00000100:00100000:2.0:1788263291.644136:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753722752 00000100:00100000:1.0:1788263291.644155:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753722496 00000100:00100000:1.0:1788263291.644160:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753722496 00000100:00100000:2.0:1788263291.644192:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788263291.644203:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753722368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263291.644244:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753722624 00000100:00100000:3.0:1788263291.644249:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753722624 00000100:00100000:3.0:1788263291.644277:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753722880 00000100:00100000:3.0:1788263291.644291:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753722880 00000100:00100000:3.0:1788263291.644313:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788263291.644321:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753722624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263291.644380:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753722624:12345-0@lo:400:kworker.0 Request processed in 59us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263291.644387:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788263291.644404:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788263291.644410:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753722880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263291.644442:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753722880:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263291.644449:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788263291.644475:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753722240 00000100:00100000:3.0:1788263291.644478:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753722240 00000100:00100000:3.0:1788263291.644568:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788263291.644576:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753722240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263291.644606:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753722240:12345-0@lo:400:kworker.0 Request processed in 31us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263291.644612:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788263291.644711:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753722368:12345-0@lo:400:kworker.0 Request processed in 508us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263291.645796:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788263291.645811:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753722752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263291.645868:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753722752:12345-0@lo:400:kworker.0 Request processed in 64us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263291.645889:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788263291.645905:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788263291.645911:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753722496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263291.645941:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753722496:12345-0@lo:400:kworker.0 Request processed in 30us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263291.645946:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788263291.645995:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263291.646000:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263291.646003:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263291.646050:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753722240:0@lo:400:kworker.0 00000100:00100000:1.0:1788263291.646066:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753722752:0@lo:400:kworker.0 00000100:00100000:1.0:1788263291.646078:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753722624:0@lo:400:kworker.0 00000100:00100000:1.0:1788263291.646124:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753722496:0@lo:400:kworker.0 00000100:00100000:1.0:1788263291.646135:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753722368:0@lo:400:kworker.0 00010000:00080000:1.0:1788263291.646148:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437fd70000 x1875129753722880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263291.646159:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753722880:0@lo:400:kworker.0 00000100:00100000:2.0:1788263291.653863:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00010000:1.0:1788263292.096556:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263292.155666:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753723008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263292.155748:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263292.155786:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753723008 00000100:00100000:3.0:1788263292.155796:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753723008 00000100:00100000:3.0:1788263292.155853:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263292.155861:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788263292.155865:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753723008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263292.155872:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1788263292.155909:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263292.155969:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753723008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263292.155976:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788263292.156027:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943810d8a80 x1875129753723008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263292.156048:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753723008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263292.667695:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753723136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263292.667879:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263292.668252:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753723136 00000100:00100000:0.0:1788263292.668273:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753723136 00000100:00100000:0.0:1788263292.668335:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788263292.668346:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753723136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263292.668386:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263292.668445:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753723136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263292.668453:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263292.668545:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753723136:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788263293.115559:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263294.140463:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263294.194130:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263294.194452:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263294.194553:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735863808 00000100:00100000:2.0:1788263294.194563:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735863808 00000100:00100000:2.0:1788263294.194646:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 105 00000100:00100000:2.0:1788263294.194657:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735863808:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263294.194766:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735863808:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 111us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263294.194775:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 105 00000100:00080000:0.0:1788263294.195118:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263294.197864:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735863680 00000100:00100000:1.0:1788263294.197877:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735863680 00000100:00100000:1.0:1788263294.198007:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 274 00000100:00100000:1.0:1788263294.198029:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2362:x1875129735863680:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263294.198124:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2362:x1875129735863680:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 97us (4003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263294.198131:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 274 00000100:00100000:2.0:1788263294.205913:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263294.206028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263294.207553:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735864064 00000100:00100000:1.0:1788263294.207566:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735864064 00000100:00100000:1.0:1788263294.207666:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:1.0:1788263294.207676:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735864064:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263294.207774:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735864064:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 99us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263294.207782:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00080000:0.0:1788263294.208267:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263294.212616:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735863936 00000100:00100000:3.0:1788263294.212629:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735863936 00000100:00100000:3.0:1788263294.212746:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1788263294.212755:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2358:x1875129735863936:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1788263294.212783:0:6702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955ccd 00000100:00080000:3.0:1788263294.212802:0:6702:0:(import.c:65:import_set_state_nolock()) ffff99437fa2e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788263294.212848:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788263294.213662:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+2:2358:x1875129735863936:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 905us (7756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263294.213672:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:2.0:1788263294.214744:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263294.223156:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788263295.164565:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263296.187721:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263296.767526:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753723648:0@lo:400:kworker.0 00000100:00100000:2.0:1788263296.767604:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263296.767679:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788263296.767686:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753723264:0@lo:400:kworker.0 00000100:00100000:2.0:1788263296.767713:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263296.767734:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753723776:0@lo:400:kworker.0 00000100:00100000:2.0:1788263296.767757:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263296.767786:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753723776 00000100:00100000:2.0:1788263296.767792:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753723776 00000100:00100000:2.0:1788263296.767842:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788263296.767851:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753723776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263296.767887:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753723648 00000100:00100000:1.0:1788263296.767894:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753723648 00000100:00100000:2.0:1788263296.767903:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753723776:12345-0@lo:400:kworker.0 Request processed in 52us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263296.767912:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788263296.767948:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788263296.767958:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753723776:0@lo:400:kworker.0 00000100:00100000:1.0:1788263296.767960:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753723648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263296.768014:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753723648:12345-0@lo:400:kworker.0 Request processed in 58us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263296.768022:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788263296.768025:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753723648:0@lo:400:kworker.0 00000100:00100000:0.0:1788263296.768451:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753723392:0@lo:400:kworker.0 00000100:00100000:0.0:1788263296.768484:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263296.768516:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753723904:0@lo:400:kworker.0 00000100:00100000:0.0:1788263296.768549:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263296.768577:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263296.768583:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753723520:0@lo:400:kworker.0 00000100:00100000:0.0:1788263296.768605:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788263296.768632:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263296.768637:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263296.768646:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753723392 00000100:00100000:0.0:1788263296.768650:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753723392 00000100:00100000:0.0:1788263296.768674:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753723520 00000100:00100000:0.0:1788263296.768677:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753723520 00000100:00100000:0.0:1788263296.768697:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788263296.768703:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753723392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263296.768739:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753723392:12345-0@lo:400:kworker.0 Request processed in 36us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263296.768746:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788263296.768762:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788263296.768769:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753723520:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788263296.768785:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263296.768800:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753723520:12345-0@lo:400:kworker.0 Request processed in 30us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263296.768808:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788263296.768823:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753723520:0@lo:400:kworker.0 00000100:00100000:1.0:1788263296.768839:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753723392:0@lo:400:kworker.0 00000100:00100000:2.0:1788263296.768887:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753723904 00000100:00100000:2.0:1788263296.768893:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753723904 00000100:00100000:2.0:1788263296.768944:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788263296.768950:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753723904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263296.768984:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753723904:12345-0@lo:400:kworker.0 Request processed in 35us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263296.768991:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788263296.769313:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788263296.769335:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437a7b9880 x1875129753723904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263296.769347:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753723904:0@lo:400:kworker.0 00000100:00100000:3.0:1788263296.769850:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753723264 00000100:00100000:3.0:1788263296.769856:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753723264 00000100:00100000:3.0:1788263296.769899:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788263296.769907:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753723264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263296.769966:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434f08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753723264:12345-0@lo:400:kworker.0 Request processed in 60us (2251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263296.769973:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788263296.770409:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753723264:0@lo:400:kworker.0 00010000:00010000:0.0:1788263297.211477:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263297.277685:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263297.277708:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753724032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263297.277783:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263297.277919:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753724032 00000100:00100000:0.0:1788263297.277941:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753724032 00000100:00100000:0.0:1788263297.277989:0:11722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263297.277998:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753724032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263297.278034:0:11722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263297.278092:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753724032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263297.278099:0:11722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788263297.278171:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943810d8e00 x1875129753724032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263297.278202:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753724032:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788263297.334618:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:0.0:1788263297.334629:0:6729:0:(genops.c:885:class_export_put()) final put ffff99437fa2c800/fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:3.0:1788263297.334692:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fa2c800/fedef325-db54-4469-b29a-301ff58466df for lustre-OST0000 00000020:00000080:3.0:1788263297.334747:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99437fa2e800 for lustre-OST0000 00000100:00100000:1.0:1788263297.794558:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753724160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263297.794632:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263297.794700:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753724160 00000100:00100000:1.0:1788263297.794708:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753724160 00000100:00100000:1.0:1788263297.794750:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788263297.794759:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753724160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263297.794792:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263297.794834:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753724160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263297.794841:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788263297.794885:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753724160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263298.237937:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263299.266161:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263299.322288:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263299.322324:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263299.322345:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263299.322384:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735864192 00000100:00100000:2.0:1788263299.322395:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735864192 00000100:00100000:2.0:1788263299.322449:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 276 00000100:00100000:2.0:1788263299.322459:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735864192:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263299.322536:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735864192:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263299.322544:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 276 00000100:00100000:2.0:1788263299.322577:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735864448 00000100:00100000:2.0:1788263299.322581:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735864448 00000100:00100000:2.0:1788263299.322614:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735864320 00000100:00100000:2.0:1788263299.322618:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735864320 00000100:00100000:2.0:1788263299.322639:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:2.0:1788263299.322646:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735864448:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263299.322676:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735864448:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263299.322682:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:2.0:1788263299.322710:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:2.0:1788263299.322716:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735864320:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263299.322741:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735864320:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263299.322747:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00080000:2.0:1788263299.323317:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788263299.836899:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788263300.283708:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263301.314008:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788263301.773485:0:11871:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:48:19 (1788263299) 00000100:00100000:0.0:1788263301.883639:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753724672:0@lo:400:kworker.0 00000100:00100000:0.0:1788263301.883718:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263301.883780:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788263301.883787:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753724288:0@lo:400:kworker.0 00000100:00100000:0.0:1788263301.883814:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263301.883835:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753724800:0@lo:400:kworker.0 00000100:00100000:0.0:1788263301.883858:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263301.883889:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753724672 00000100:00100000:0.0:1788263301.883897:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753724672 00000100:00100000:0.0:1788263301.883954:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788263301.883964:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753724672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263301.884033:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753724672:12345-0@lo:400:kworker.0 Request processed in 70us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263301.884041:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788263301.884064:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753724288 00000100:00100000:0.0:1788263301.884074:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753724288 00000100:00100000:0.0:1788263301.884110:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788263301.884117:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753724288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263301.884157:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753724288:12345-0@lo:400:kworker.0 Request processed in 41us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263301.884165:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788263301.884194:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753724800 00000100:00100000:0.0:1788263301.884198:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753724800 00000100:00100000:0.0:1788263301.884255:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788263301.884262:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753724800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263301.884293:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753724800:12345-0@lo:400:kworker.0 Request processed in 32us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263301.884299:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788263301.884315:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263301.884320:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263301.884350:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753724288:0@lo:400:kworker.0 00000100:00100000:0.0:1788263301.884363:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753724800:0@lo:400:kworker.0 00000100:00100000:0.0:1788263301.884372:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753724672:0@lo:400:kworker.0 00000100:00100000:1.0:1788263301.884570:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753724416:0@lo:400:kworker.0 00000100:00100000:1.0:1788263301.884604:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263301.884632:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753724928:0@lo:400:kworker.0 00000100:00100000:1.0:1788263301.884662:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263301.884688:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263301.884694:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753724544:0@lo:400:kworker.0 00000100:00100000:1.0:1788263301.884715:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263301.884745:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753724928 00000100:00100000:1.0:1788263301.884749:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753724928 00000100:00100000:1.0:1788263301.884779:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788263301.884786:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753724928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263301.884820:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753724928:12345-0@lo:400:kworker.0 Request processed in 35us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263301.884826:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788263301.884845:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753724416 00000100:00100000:1.0:1788263301.884848:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753724416 00000100:00100000:1.0:1788263301.884866:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753724544 00000100:00100000:1.0:1788263301.884869:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753724544 00000100:00100000:1.0:1788263301.884887:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788263301.884894:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753724416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263301.884923:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753724416:12345-0@lo:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263301.884929:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788263301.884941:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788263301.884947:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753724544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263301.884973:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753724544:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263301.884979:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788263301.884991:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263301.884994:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263301.885035:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753724544:0@lo:400:kworker.0 00000100:00100000:1.0:1788263301.885046:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753724416:0@lo:400:kworker.0 00010000:00080000:1.0:1788263301.885057:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994379f27480 x1875129753724928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263301.885065:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753724928:0@lo:400:kworker.0 00010000:00010000:1.0:1788263302.331781:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263302.396041:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753725056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263302.396148:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263302.396615:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753725056 00000100:00100000:0.0:1788263302.396624:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753725056 00000100:00100000:0.0:1788263302.396692:0:11722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263302.396702:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753725056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263302.396737:0:11722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263302.396797:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753725056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263302.396805:0:11722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788263302.397264:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994379f25500 x1875129753725056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263302.397284:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753725056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263302.907572:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263302.907607:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753725184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263302.907702:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263302.907874:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753725184 00000100:00100000:1.0:1788263302.907884:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753725184 00000100:00100000:1.0:1788263302.907952:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788263302.907964:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753725184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263302.908042:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263302.908146:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753725184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263302.908155:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788263302.908601:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753725184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263303.357513:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263303.694706:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263303.695168:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735864576 00000100:00100000:1.0:1788263303.695191:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735864576 00000100:00100000:1.0:1788263303.695319:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1788263303.695333:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+5:10224:x1875129735864576:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263303.695360:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263303.695390:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d302e expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788263303.695514:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788263303.695844:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955d9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263303.695861:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263303.695894:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263303.695938:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788263303.695942:0:6725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263303.695990:0:6725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263303.696022:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d302e expref: 7 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263303.696043:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955d9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d302e expref: 6 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263303.696053:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5400) 00010000:00010000:1.0:1788263303.696056:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263303.696061:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159a00, rc 0) 00000100:00100000:1.0:1788263303.696814:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+6:10224:x1875129735864576:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1477us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263303.696825:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:2.0:1788263303.718279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263303.718465:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735864704 00000100:00100000:0.0:1788263303.718478:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735864704 00000100:00100000:0.0:1788263303.718765:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:0.0:1788263303.718776:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+6:10225:x1875129735864704:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263303.718801:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263303.718825:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955da6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3035 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.718893:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.718906:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.718916:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.718928:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.718932:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.718936:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.719396:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955dbb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.719406:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955dbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.719424:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955dbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263303.719463:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788263303.719467:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263303.719495:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955dbb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.719508:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.719516:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.720447:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.720456:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263303.720461:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.720471:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.720490:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5400) 00010000:00010000:0.0:1788263303.720493:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263303.720500:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.720507:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513955dad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.724035:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.724045:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.724053:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.724060:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263303.727253:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.727286:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.727312:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff994344cabe00) 00010000:00010000:0.0:1788263303.727315:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263303.727322:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.727330:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513955db4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.727429:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513955da6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3035 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.727447:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955dbb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3035 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263303.727487:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994344cabf00) 00010000:00010000:0.0:1788263303.727490:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263303.727492:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658800, rc 0) 00000100:00100000:0.0:1788263303.727847:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+7:10225:x1875129735864704:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 9068us (9632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263303.727857:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:0.0:1788263303.733729:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263303.734020:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735864960 00000100:00100000:2.0:1788263303.734033:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735864960 00000100:00100000:2.0:1788263303.734120:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:2.0:1788263303.734131:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+7:10225:x1875129735864960:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263303.734160:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263303.734184:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955dc2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d303c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.734332:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.734349:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.734363:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.739679:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.739703:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.739716:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740052:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513955dd7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740419:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513955dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740428:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513955dd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263303.740440:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788263303.740581:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740589:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740596:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740602:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263303.740607:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740835:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740849:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994344cabf00) 00010000:00010000:2.0:1788263303.740852:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263303.740856:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740863:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955dc9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740875:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740880:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740886:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740892:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263303.740895:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740901:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740907:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99434314f400) 00010000:00010000:2.0:1788263303.740909:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263303.740911:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.740982:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955dd0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.741587:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955dc2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d303c expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.741604:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513955dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d303c expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263303.741612:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:2.0:1788263303.741614:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263303.741617:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6000, rc 0) 00000100:00100000:2.0:1788263303.741758:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+9:10225:x1875129735864960:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 7628us (8044us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788263303.741766:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1788263303.753715:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263303.754112:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735865088 00000100:00100000:2.0:1788263303.754125:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735865088 00000100:00100000:2.0:1788263303.754202:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:2.0:1788263303.754262:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+9:10225:x1875129735865088:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788263303.754473:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+9:10225:x1875129735865088:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 260us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263303.754481:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000040:00080000:0.0:1788263303.934312:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788263304.382838:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263304.422938:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263304.423289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263304.424993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263304.425438:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735865344 00000100:00100000:0.0:1788263304.425456:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735865344 00000100:00100000:0.0:1788263304.425549:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735865472 00000100:00100000:0.0:1788263304.425553:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735865472 00000100:00100000:0.0:1788263304.425596:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:0.0:1788263304.425608:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+9:2360:x1875129735865344:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263304.425704:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+9:2360:x1875129735865344:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 98us (2415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263304.425712:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:0.0:1788263304.425730:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:0.0:1788263304.425736:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735865472:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263304.426837:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735865472:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 1090us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263304.426851:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00080000:0.0:1788263304.426895:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263304.427722:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735865216 00000100:00100000:2.0:1788263304.427737:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735865216 00000100:00100000:2.0:1788263304.428443:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 278 00000100:00100000:2.0:1788263304.428457:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735865216:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263304.428575:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735865216:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 121us (5652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263304.428583:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 278 00010000:00010000:1.0:1788263305.405007:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263305.863136:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263305.866158:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735865600 00000100:00100000:0.0:1788263305.866191:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735865600 00000100:00100000:0.0:1788263305.866314:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:0.0:1788263305.866325:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+9:10268:x1875129735865600:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263305.866345:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263305.866368:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955de5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3043 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866437:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866453:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866464:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866479:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866486:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866492:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866668:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866676:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866683:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866694:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263305.866699:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866706:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866720:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5400) 00010000:00010000:0.0:1788263305.866723:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263305.866727:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866732:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513955dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866746:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866751:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866756:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866760:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263305.866763:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866768:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866786:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff994344cab500) 00010000:00010000:0.0:1788263305.866788:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263305.866790:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866796:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955df3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866828:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955de5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3043 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866837:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5400) 00010000:00010000:0.0:1788263305.866839:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263305.866843:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955de5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3043 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.866851:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658e00, rc 0) 00000100:00100000:0.0:1788263305.866941:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+9:10268:x1875129735865600:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 617us (3816us total) trans 0 rc 301/301 00000100:00100000:0.0:1788263305.866949:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00080000:2.0:1788263305.867124:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263305.872783:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263305.872907:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735865856 00000100:00100000:1.0:1788263305.872925:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735865856 00000100:00100000:1.0:1788263305.872994:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:1.0:1788263305.873009:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+9:10268:x1875129735865856:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:1.0:1788263305.873076:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263305.873118:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955d9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d302e expref: 9 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.873138:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5400) 00010000:00010000:1.0:1788263305.873151:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263305.873389:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.873402:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.873411:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.873422:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.873428:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.873434:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263305.874299:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788263305.874313:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.874321:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.874327:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.874342:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263305.874347:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.874354:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.874364:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:1.0:1788263305.874367:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263305.874370:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263305.874376:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955dfa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263305.874390:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f42854cb reply state 00000000c05f4df6 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263305.874399:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263305.874511:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+10:10268:x1875129735865856:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 1506us (1743us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788263305.874520:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00010000:00010000:2.0:1788263305.878512:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263305.878531:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263305.878539:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263305.878545:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263305.878550:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263305.878557:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263305.878576:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9943565b5900) 00010000:00010000:2.0:1788263305.878579:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263305.878583:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263305.878589:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513955e01 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263305.976124:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263305.976378:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735865984 00000100:00100000:0.0:1788263305.976394:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735865984 00000100:00100000:0.0:1788263305.976475:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1788263305.976486:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+9:10276:x1875129735865984:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:0.0:1788263305.976512:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263305.976537:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955e08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d304a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.976625:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955e0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.976639:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.976651:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263305.976685:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788263305.976689:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263305.976730:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.976755:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955e08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d304a expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.976791:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955e0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d304a expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263305.976800:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263305.976803:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263305.976806:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659600, rc 0) 00000100:00100000:0.0:1788263305.976893:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+10:10276:x1875129735865984:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 409us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263305.976900:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:3.0:1788263306.060446:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263306.060621:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735866112 00000100:00100000:0.0:1788263306.060632:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735866112 00000100:00100000:0.0:1788263306.060778:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1788263306.060788:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+10:10282:x1875129735866112:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788263306.060823:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263306.060846:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955e16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3051 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.060919:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.060932:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.060941:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.060954:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.060961:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.060968:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061083:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658a00/0x1a657bc513955e2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061091:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658a00/0x1a657bc513955e2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061098:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658a00/0x1a657bc513955e2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263306.061134:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788263306.061138:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263306.061178:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380658a00/0x1a657bc513955e2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061189:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061195:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061202:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061208:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263306.061211:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061254:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061267:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263306.061270:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263306.061274:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061280:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061295:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061312:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061318:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061323:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263306.061326:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061332:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061340:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff994344cab000) 00010000:00010000:0.0:1788263306.061343:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263306.061345:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061351:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955e24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061383:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955e16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3051 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061395:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658a00/0x1a657bc513955e2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3051 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.061401:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:0.0:1788263306.061403:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788263306.061412:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658a00, rc 0) 00000100:00100000:0.0:1788263306.061482:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+11:10282:x1875129735866112:12345-192.168.201.29@tcp:101:bash.0 Request processed in 695us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263306.061489:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1788263306.069438:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.069617:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735866368 00000100:00100000:2.0:1788263306.069628:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735866368 00000100:00100000:2.0:1788263306.069699:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:2.0:1788263306.069711:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+11:10282:x1875129735866368:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263306.069732:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263306.069755:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955e32 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3058 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.070245:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.070260:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.070271:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.070310:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.070318:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.070325:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788263306.071318:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788263306.071492:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071504:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071512:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071556:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071563:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071569:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071575:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263306.071579:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071586:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071598:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263306.071601:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263306.071605:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071611:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955e39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263306.071625:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067a30555 reply state 00000000d1582e3e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263306.071635:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788263306.071669:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955e32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3058 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071697:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3058 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.071705:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314f900) 00010000:00010000:2.0:1788263306.071707:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263306.071710:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263306.071825:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+14:10282:x1875129735866368:12345-192.168.201.29@tcp:101:bash.0 Request processed in 2110us (2390us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788263306.071834:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00010000:00010000:1.0:1788263306.076564:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.076583:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.076591:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.076615:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263306.076620:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.076628:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.076648:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99434314f200) 00010000:00010000:1.0:1788263306.076651:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263306.076656:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.076662:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955e40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263306.085347:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263306.085451:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735866496 00000100:00100000:0.0:1788263306.085462:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735866496 00000100:00100000:0.0:1788263306.085512:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788263306.085521:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875129735866496:12345-192.168.201.29@tcp:8:bash.0 00010000:00080000:0.0:1788263306.085556:0:8112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:0.0:1788263306.085592:0:8112:0:(genops.c:1385:class_connect()) connect: client fedef325-db54-4469-b29a-301ff58466df, cookie 0x1a657bc513955e55 00002000:00100000:0.0:1788263306.085605:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fedef325-db54-4469-b29a-301ff58466df/ffff99434646f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788263306.085629:0:8112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788263306.085867:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788263306.086353:0:8112:0:(import.c:65:import_set_state_nolock()) ffff99434646d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263306.086430:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:2358:x1875129735866496:12345-192.168.201.29@tcp:8:bash.0 Request processed in 907us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263306.086439:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1788263306.092859:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.093080:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735866624 00000100:00100000:2.0:1788263306.093090:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735866624 00000100:00100000:2.0:1788263306.093169:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788263306.093180:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:0:x1875129735866624:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263306.093200:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263306.093265:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d305f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263306.093293:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263306.093310:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1788263306.093315:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263306.093325:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d305f expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.093346:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d305f expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.093380:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6e00, rc 0) 00000100:00100000:2.0:1788263306.093445:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:0:x1875129735866624:12345-192.168.201.29@tcp:101:bash.0 Request processed in 266us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263306.093452:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00080000:0.0:1788263306.095328:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263306.105590:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.105713:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735866752 00000100:00100000:2.0:1788263306.105724:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735866752 00000100:00100000:2.0:1788263306.106191:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:2.0:1788263306.106203:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+7:10282:x1875129735866752:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263306.106242:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263306.106262:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3066 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.106295:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d305f expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.106305:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263306.106311:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263306.106316:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.106352:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d305f expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.106366:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d305f expref: 8 pid: 6702 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263306.106397:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875129753725312:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263306.106503:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346507780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263306.109667:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875129753725312:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263306.109702:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.109723:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7800, rc 0) 00000100:00100000:2.0:1788263306.109801:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+8:10282:x1875129735866752:12345-192.168.201.29@tcp:101:bash.0 Request processed in 3593us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263306.109811:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1788263306.113668:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263306.114257:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735866880 00000100:00100000:0.0:1788263306.114267:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735866880 00010000:00010000:0.0:1788263306.114312:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d305f expref: 8 pid: 6702 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263306.114354:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:0.0:1788263306.114364:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+8:2360:x1875129735866880:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263306.114378:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263306.114418:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d305f expref: 8 pid: 6702 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.114432:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d305f expref: 8 pid: 6702 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.114458:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186f1bcc/0x1a657bc513955e5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d305f expref: 8 pid: 6702 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.114475:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263306.114479:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263306.114486:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.114496:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.114532:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263306.114547:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5837:1875129753725440:192.168.201.29@tcp:105: 00000100:00100000:0.0:1788263306.114758:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263306.129476:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263306.129573:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735867136 00000100:00100000:3.0:1788263306.129582:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735867136 00000100:00100000:3.0:1788263306.129645:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788263306.129655:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+13:10282:x1875129735867136:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:3.0:1788263306.130429:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+14:10282:x1875129735867136:12345-192.168.201.29@tcp:35:bash.0 Request processed in 772us (961us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788263306.130439:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788263306.132289:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5837:1875129753725440:192.168.201.29@tcp:105: 00010000:00010000:0.0:1788263306.132318:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263306.132370:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+7:2360:x1875129735866880:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 18007us (18711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263306.132399:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:1.0:1788263306.213777:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.214154:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735867392 00000100:00100000:2.0:1788263306.214165:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735867392 00000100:00100000:2.0:1788263306.214263:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:2.0:1788263306.214274:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+14:10292:x1875129735867392:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263306.214300:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263306.214321:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d306d expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263306.214418:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788263306.214550:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955e6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d306d expref: 16 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.214567:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263306.214570:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263306.214591:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d306d expref: 16 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.214605:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6c00, rc 0) 00000100:00100000:2.0:1788263306.214679:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+15:10292:x1875129735867392:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 406us (915us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788263306.214687:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1788263306.218614:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263306.218706:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735867648 00000100:00100000:3.0:1788263306.218716:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735867648 00000100:00100000:3.0:1788263306.218777:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788263306.218788:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+15:10292:x1875129735867648:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1788263306.219395:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+16:10292:x1875129735867648:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 607us (789us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788263306.219404:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788263306.302535:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.302732:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735867776 00000100:00100000:2.0:1788263306.302742:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735867776 00000100:00100000:2.0:1788263306.302806:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:2.0:1788263306.302816:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+16:10298:x1875129735867776:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263306.302842:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263306.302865:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955e78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3074 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.302942:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955e7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.302955:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.302968:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263306.303001:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788263306.303004:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263306.303022:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.303061:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3074 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.303094:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3074 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.303101:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263306.303104:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263306.303108:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6a00, rc 0) 00000100:00100000:2.0:1788263306.303172:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+17:10298:x1875129735867776:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 358us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263306.303179:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1788263306.309334:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.309458:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735868032 00000100:00100000:2.0:1788263306.309468:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735868032 00000100:00100000:2.0:1788263306.309529:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:2.0:1788263306.309541:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+17:10298:x1875129735868032:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263306.309561:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263306.309583:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955e86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d307b expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.309684:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955e8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.309698:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.309709:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263306.309722:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788263306.310188:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955e86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d307b expref: 20 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.310210:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955e8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d307b expref: 19 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.310275:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314f900) 00010000:00010000:2.0:1788263306.310278:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263306.310282:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6200, rc 0) 00000100:00100000:2.0:1788263306.310343:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+19:10298:x1875129735868032:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 804us (1020us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788263306.310352:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:1.0:1788263306.316097:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263306.316143:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263306.316261:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735868416 00000100:00100000:0.0:1788263306.316271:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735868416 00000100:00100000:0.0:1788263306.316334:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1788263306.316345:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+19:2359:x1875129735868416:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263306.316361:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263306.316386:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955e8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d307b expref: 19 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.316405:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314f900) 00010000:00010000:0.0:1788263306.316409:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263306.316470:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+18:2359:x1875129735868416:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 127us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263306.316477:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788263306.316771:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735868288 00000100:00100000:2.0:1788263306.316776:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735868288 00000100:00100000:2.0:1788263306.316822:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1788263306.316830:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+18:10298:x1875129735868288:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263306.316851:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263306.316866:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955e9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3082 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.317101:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ea2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.317115:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.317125:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263306.317155:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788263306.317572:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955e9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3082 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.317590:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3082 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.317599:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314f900) 00010000:00010000:2.0:1788263306.317602:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788263306.317605:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6e00, rc 0) 00000100:00100000:2.0:1788263306.317655:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+20:10298:x1875129735868288:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 826us (1569us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788263306.317662:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1788263306.327601:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.327704:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735868544 00000100:00100000:2.0:1788263306.327716:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735868544 00000100:00100000:2.0:1788263306.327777:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788263306.327788:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735868544:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:2.0:1788263306.327845:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.327865:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.328143:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788263306.328149:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263306.328154:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.328211:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.328269:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 7 pid: 6704 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263306.328285:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1875129753725568:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263306.328472:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346507780 going to sleep for 11 seconds 00000100:00100000:3.0:1788263306.331742:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.331849:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1875129753725568:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263306.331888:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263306.331999:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735868672 00000100:00100000:0.0:1788263306.332006:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735868672 00002000:00100000:0.0:1788263306.332061:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9943755aaa00 x1875129735868672/t0(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:517/0 lens 504/0 e 0 to 0 dl 1788263317 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263306.332071:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9943755aaa00 with x1875129735868672 ext(0->12) 00010000:00010000:0.0:1788263306.332079:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 8 pid: 6704 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.332093:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 8 pid: 6704 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263306.332101:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9943755aaa00 00000100:00100000:0.0:1788263306.332161:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788263306.332171:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735868672:12345-192.168.201.29@tcp:4:lfs.0 00000001:00100000:2.0:1788263306.405661:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000100:00100000:0.0:1788263306.406705:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+9:2362:x1875129735868672:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 74524us (74961us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788263306.406722:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00002000:00100000:0.0:1788263306.406738:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9943755aaa00 x1875129735868672/t4294967299(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:517/0 lens 504/448 e 0 to 0 dl 1788263317 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263306.406748:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9943755aaa00 with x1875129735868672 ext(0->12) 00010000:00010000:0.0:1788263306.406760:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 9 pid: 6704 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.406782:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 9 pid: 6704 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263306.406790:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9943755aaa00 00000100:00100000:1.0:1788263306.415766:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.416745:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735868800 00000100:00100000:2.0:1788263306.416761:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735868800 00010000:00010000:2.0:1788263306.416817:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 9 pid: 6704 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263306.416867:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:2.0:1788263306.416877:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+9:2360:x1875129735868800:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263306.416892:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788263306.416913:0:5839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788263306.416916:0:5839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788263305 00002000:00010000:2.0:1788263306.416919:0:5839:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788263306 00002000:00010000:2.0:1788263306.417067:0:5839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788263305 00010000:00010000:2.0:1788263306.417075:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 9 pid: 6704 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.417091:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 9 pid: 6704 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.417118:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc513955e63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3066 expref: 9 pid: 6704 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.417136:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263306.417141:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263306.417146:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.417156:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.417192:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263306.417434:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.417445:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.417478:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.417487:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.417496:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.417505:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263306.417511:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.417523:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.417543:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.417551:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000748e5982/0x1a657bc513955eb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263306.417614:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735868544:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 89827us (90025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263306.417623:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788263306.417873:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+7:2360:x1875129735868800:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 995us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263306.417881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:1.0:1788263306.421711:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263306.421796:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735869056 00000100:00100000:3.0:1788263306.421814:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735869056 00000100:00100000:3.0:1788263306.422008:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788263306.422020:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+20:10298:x1875129735869056:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:3.0:1788263306.422105:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3082 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263306.422713:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788263306.422767:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788263306.423691:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788263306.423766:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.423785:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3058 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.423795:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.423834:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3058 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.423850:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3058 expref: 24 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263306.423865:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875129753725696:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263306.424505:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702a9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788263306.427566:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263306.428868:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875129753725696:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263306.428934:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263306.429124:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263306.429691:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735869184 00000100:00100000:0.0:1788263306.429699:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735869184 00010000:00010000:0.0:1788263306.429739:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3058 expref: 25 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263306.429829:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:0.0:1788263306.429840:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+25:2361:x1875129735869184:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263306.429856:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263306.429864:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3058 expref: 25 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.429893:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3058 expref: 25 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.429933:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955e47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3058 expref: 25 pid: 5852 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.429951:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314f900) 00010000:00010000:0.0:1788263306.429956:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.429965:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.429973:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.430003:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263306.430081:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+24:2361:x1875129735869184:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 242us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263306.430089:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00010000:00010000:3.0:1788263306.430393:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263306.430402:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263306.430538:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788263306.430741:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788263306.430854:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875129753725824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788263306.430907:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263306.430948:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263306.431238:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753725824 00000100:00100000:1.0:1788263306.431252:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753725824 00000100:00100000:1.0:1788263306.431324:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263306.431333:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875129753725824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788263306.431405:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875129753725824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263306.431412:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263306.431454:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875129753725824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788263306.432065:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788263306.432125:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875129753725952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788263306.432170:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263306.432199:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753725952 00000100:00100000:1.0:1788263306.432203:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753725952 00000100:00100000:1.0:1788263306.432250:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263306.432257:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875129753725952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788263306.432393:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1875129753725952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 136us (222us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788263306.432400:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263306.432421:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263306.432442:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875129753725952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788263306.432480:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788263306.432512:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.432522:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.432530:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.432541:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263306.432545:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.432552:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.432568:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314f900) 00010000:00010000:1.0:1788263306.432571:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788263306.432575:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.432581:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513955eb7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788263306.432732:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788263306.432925:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788263306.432935:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333220716441ns, next at 334220714745ns, rc = 0 00000001:00080000:1.0:1788263306.432941:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788263306.432970:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314f900) 00010000:00010000:1.0:1788263306.432973:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788263306.432980:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ea2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3082 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263306.433091:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+27:10298:x1875129735869056:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 11073us (11396us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788263306.433103:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000020:00080000:1.0:1788263306.433106:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788263306.433594:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263306.437722:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.438066:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735869312 00000100:00100000:2.0:1788263306.438076:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735869312 00000100:00100000:2.0:1788263306.438174:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1788263306.438186:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+27:10298:x1875129735869312:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263306.438211:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263306.438295:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955ebe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3089 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.438763:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955ebe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3089 expref: 28 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.438781:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955ebe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3089 expref: 28 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.438800:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263306.438803:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263306.438807:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7800, rc 0) 00000100:00100000:2.0:1788263306.438876:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+28:10298:x1875129735869312:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 691us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263306.438884:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:1.0:1788263306.444335:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263306.444442:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735869568 00000100:00100000:0.0:1788263306.444452:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735869568 00000100:00100000:0.0:1788263306.444512:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263306.444522:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+28:10298:x1875129735869568:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788263306.444830:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2c9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+29:10298:x1875129735869568:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 308us (503us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788263306.444838:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1788263306.570142:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263306.578653:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735869824 00000100:00100000:0.0:1788263306.578668:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735869824 00000100:00100000:0.0:1788263306.578751:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:0.0:1788263306.578762:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+29:10308:x1875129735869824:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263306.578789:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263306.578813:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955ec5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3090 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263306.578922:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788263306.579062:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955ec5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3090 expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.579076:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263306.579079:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263306.579084:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955ec5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3090 expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.579101:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658e00, rc 0) 00000100:00100000:0.0:1788263306.579180:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+30:10308:x1875129735869824:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 419us (9049us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788263306.579187:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:3.0:1788263306.584450:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263306.584586:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735869952 00000100:00100000:1.0:1788263306.584603:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735869952 00000100:00100000:1.0:1788263306.584676:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1788263306.584688:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+30:10308:x1875129735869952:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:1.0:1788263306.584770:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.584788:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.584801:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.584817:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.584824:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.584830:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585067:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585077:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585083:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263306.585141:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585154:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585160:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585165:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585170:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263306.585174:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585181:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585193:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:1.0:1788263306.585195:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263306.585200:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585205:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513955ed3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585304:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585401:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585414:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585419:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263306.585422:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585429:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585438:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9943565b5400) 00010000:00010000:1.0:1788263306.585441:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263306.585444:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585449:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513955eda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585463:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585468:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585474:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585480:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263306.585482:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585498:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585508:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263306.585510:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263306.585513:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263306.585519:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513955ee1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263306.585610:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+30:10308:x1875129735869952:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 921us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263306.585618:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1788263306.588723:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.588812:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735870208 00000100:00100000:2.0:1788263306.588823:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735870208 00000100:00100000:2.0:1788263306.588883:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263306.588893:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+30:10308:x1875129735870208:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263306.589163:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+31:10308:x1875129735870208:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 271us (448us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788263306.589171:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263306.655404:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263306.655583:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735870464 00000100:00100000:0.0:1788263306.655599:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735870464 00000100:00100000:0.0:1788263306.655685:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:0.0:1788263306.655699:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+31:10311:x1875129735870464:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263306.655742:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263306.655768:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955ee8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3097 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.655889:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.655906:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656321:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656344:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656353:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656362:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656521:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656530:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656538:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263306.656551:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788263306.656684:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656692:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656722:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656729:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263306.656733:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656742:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656756:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:0.0:1788263306.656760:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263306.656766:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656773:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc513955eef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656795:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656802:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656807:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656812:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263306.656815:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656832:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656841:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994344cab000) 00010000:00010000:0.0:1788263306.656843:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263306.656846:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656852:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513955ef6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.656912:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513955ee8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3097 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.657565:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3097 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263306.657575:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:0.0:1788263306.657578:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263306.657582:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658c00, rc 0) 00000100:00100000:0.0:1788263306.657727:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+33:10311:x1875129735870464:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 2030us (2336us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788263306.657737:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:0.0:1788263306.663347:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.663466:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735870592 00000100:00100000:2.0:1788263306.663480:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735870592 00000100:00100000:2.0:1788263306.663595:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:2.0:1788263306.663608:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+33:10311:x1875129735870592:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1788263306.663704:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.663752:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.663767:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.663801:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.663809:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.663817:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.663824:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263306.663829:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.663839:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.663853:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263306.663856:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263306.663860:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.663867:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263306.663979:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+33:10311:x1875129735870592:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 367us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263306.663995:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1788263306.667789:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263306.667897:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735870848 00000100:00100000:0.0:1788263306.667911:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735870848 00000100:00100000:0.0:1788263306.668006:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788263306.668028:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+33:10311:x1875129735870848:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788263306.668435:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+34:10311:x1875129735870848:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 416us (660us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788263306.668443:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788263306.944338:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.944645:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735871104 00000100:00100000:2.0:1788263306.944659:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735871104 00000100:00100000:2.0:1788263306.944792:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1788263306.944805:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+34:10342:x1875129735871104:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:2.0:1788263306.944838:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263306.944863:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d309e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.945004:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955f19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.945030:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.945044:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263306.945057:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788263306.945316:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d309e expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.945338:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d309e expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.945348:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263306.945352:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263306.945355:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263306.945432:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+36:10342:x1875129735871104:12345-192.168.201.29@tcp:101:cat.0 Request processed in 629us (1109us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788263306.945440:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:0.0:1788263306.952895:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.953021:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735871360 00000100:00100000:2.0:1788263306.953035:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735871360 00000100:00100000:2.0:1788263306.953114:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788263306.953126:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+36:10342:x1875129735871360:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:2.0:1788263306.953771:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+37:10342:x1875129735871360:12345-192.168.201.29@tcp:35:cat.0 Request processed in 643us (890us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788263306.953781:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788263306.957133:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263306.957513:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735871488 00000100:00100000:2.0:1788263306.957528:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735871488 00000100:00100000:2.0:1788263306.957621:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788263306.957634:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+37:2360:x1875129735871488:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263306.957655:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263306.957688:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955f19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d309e expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263306.957725:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263306.957732:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263306.957791:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc90850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+36:2360:x1875129735871488:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 159us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263306.957799:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1788263307.003725:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753726336:0@lo:400:kworker.0 00000100:00100000:1.0:1788263307.003817:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263307.003902:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263307.003909:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753726208:0@lo:400:kworker.0 00000100:00100000:1.0:1788263307.003934:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263307.003973:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753726336 00000100:00100000:1.0:1788263307.003982:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753726336 00000100:00100000:1.0:1788263307.004051:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753726208 00000100:00100000:1.0:1788263307.004055:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753726208 00000100:00100000:1.0:1788263307.004080:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788263307.004089:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753726336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263307.004164:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753726336:12345-0@lo:400:kworker.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263307.004181:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788263307.004210:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788263307.004244:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753726208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263307.004274:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753726208:12345-0@lo:400:kworker.0 Request processed in 58us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263307.004281:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788263307.004320:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753726208:0@lo:400:kworker.0 00000100:00100000:1.0:1788263307.004330:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753726336:0@lo:400:kworker.0 00000100:00100000:3.0:1788263307.004791:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753726080:0@lo:400:kworker.0 00000100:00100000:3.0:1788263307.004838:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263307.004879:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753726592:0@lo:400:kworker.0 00000100:00100000:3.0:1788263307.004905:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263307.004931:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263307.004938:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753726464:0@lo:400:kworker.0 00000100:00100000:3.0:1788263307.004975:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788263307.005004:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263307.005079:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753726080 00000100:00100000:0.0:1788263307.005087:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753726080 00000100:00100000:0.0:1788263307.005143:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788263307.005152:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753726080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263307.005215:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753726080:12345-0@lo:400:kworker.0 Request processed in 65us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263307.005243:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788263307.005282:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753726464 00000100:00100000:0.0:1788263307.005286:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753726464 00000100:00100000:0.0:1788263307.005320:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788263307.005327:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753726464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263307.005359:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753726464:12345-0@lo:400:kworker.0 Request processed in 33us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263307.005366:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788263307.005402:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753726464:0@lo:400:kworker.0 00000100:00100000:0.0:1788263307.005412:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753726080:0@lo:400:kworker.0 00000100:00080000:3.0:1788263307.005742:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263307.006059:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753726592 00000100:00100000:2.0:1788263307.006067:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753726592 00000100:00100000:2.0:1788263307.006134:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788263307.006143:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753726592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263307.006253:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753726592:12345-0@lo:400:kworker.0 Request processed in 110us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263307.006261:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788263307.007338:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753726592:0@lo:400:kworker.0 00000100:00080000:3.0:1788263307.007428:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263307.068294:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263307.068465:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735871744 00000100:00100000:2.0:1788263307.068478:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735871744 00000100:00100000:2.0:1788263307.068575:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:2.0:1788263307.068587:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+36:10348:x1875129735871744:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:2.0:1788263307.068624:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263307.068628:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788263307.068667:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955e7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3074 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.068693:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263307.068699:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263307.068717:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955f27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30a5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.068856:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.068871:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3097 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.068880:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.068922:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3097 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.068964:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3097 expref: 36 pid: 5854 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263307.068980:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753726720:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263307.069123:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff994342bee300 going to sleep for 11 seconds 00000100:00080000:3.0:1788263307.069786:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263307.075870:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753726720:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263307.075925:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263307.078698:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263307.078816:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735871872 00000100:00100000:2.0:1788263307.078831:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735871872 00010000:00010000:2.0:1788263307.078888:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3097 expref: 37 pid: 5854 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263307.078946:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:2.0:1788263307.078964:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+37:2361:x1875129735871872:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263307.078992:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263307.079000:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3097 expref: 37 pid: 5854 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.079026:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3097 expref: 37 pid: 5854 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.079056:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513955efd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3097 expref: 37 pid: 5854 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.079102:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263307.079109:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.079121:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.079131:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.079442:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263307.079519:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+36:2361:x1875129735871872:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 555us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263307.079529:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00010000:00010000:3.0:1788263307.082409:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.082430:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263307.082468:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788263307.082735:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513955f27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30a5 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.082769:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30a5 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.082781:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263307.082784:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788263307.082788:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7600, rc 0) 00000100:00100000:3.0:1788263307.083490:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+36:10348:x1875129735871744:12345-192.168.201.29@tcp:101:dd.0 Request processed in 14899us (15207us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788263307.083513:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:0.0:1788263307.088571:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263307.088689:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735872128 00000100:00100000:1.0:1788263307.088703:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735872128 00000100:00100000:1.0:1788263307.088814:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1788263307.088829:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+36:10348:x1875129735872128:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:1.0:1788263307.089596:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.089627:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.089642:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263307.089709:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788263307.089735:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1c89839 reply state 00000000c48fd556 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263307.089746:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263307.089974:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+39:10348:x1875129735872128:12345-192.168.201.29@tcp:36:dd.0 Request processed in 1086us (1356us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788263307.090003:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000020:00080000:1.0:1788263307.090019:0:6725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788263307.096841:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.096866:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.096875:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.096881:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263307.096896:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.096905:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.096936:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263307.096939:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263307.096944:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.096952:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955f3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263307.370346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263307.370492:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735872256 00000100:00100000:2.0:1788263307.370506:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735872256 00000100:00100000:2.0:1788263307.370583:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:2.0:1788263307.370596:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+38:10362:x1875129735872256:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:2.0:1788263307.370632:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263307.370660:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955f43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.370749:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.370766:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.370782:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.370811:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.370818:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.370825:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.370960:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.370973:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30a5 expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.370983:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.371038:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30a5 expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.371053:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30a5 expref: 39 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263307.371070:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753726848:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263307.371210:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff994342bee300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263307.377049:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263307.377277:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735872512 00000100:00100000:3.0:1788263307.377290:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735872512 00000100:00100000:3.0:1788263307.377377:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788263307.377391:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+40:5597:x1875129735872512:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788263307.377847:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+41:5597:x1875129735872512:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 457us (811us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788263307.377856:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1788263307.378829:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753726848:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263307.378867:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263307.382163:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263307.382386:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735872640 00000100:00100000:0.0:1788263307.382400:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735872640 00010000:00010000:0.0:1788263307.382459:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30a5 expref: 41 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263307.382516:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1788263307.382529:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+41:2362:x1875129735872640:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263307.382549:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263307.382558:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30a5 expref: 41 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.382575:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30a5 expref: 41 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.382602:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513955f2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30a5 expref: 41 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.382624:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:0.0:1788263307.382631:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.382643:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.382652:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.382699:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263307.382895:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+40:2362:x1875129735872640:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 367us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263307.382936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00010000:00010000:1.0:1788263307.383033:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383042:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263307.383114:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788263307.383121:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263307.383174:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383191:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383204:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383212:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383265:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383273:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263307.383278:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383287:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383306:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:1.0:1788263307.383309:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263307.383314:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383321:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955f4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383334:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383341:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383347:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383353:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263307.383356:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383362:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383370:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99434314f700) 00010000:00010000:1.0:1788263307.383373:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263307.383376:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383383:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955f51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383445:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955f43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30ac expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383461:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30ac expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.383469:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263307.383472:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263307.383474:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6200, rc 0) 00000100:00100000:1.0:1788263307.383515:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+39:10362:x1875129735872256:12345-192.168.201.29@tcp:101:stat.0 Request processed in 12921us (13183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263307.383523:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00010000:00010000:1.0:1788263307.451516:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263307.460756:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263307.461045:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735872896 00000100:00100000:1.0:1788263307.461060:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735872896 00000100:00100000:1.0:1788263307.461152:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:1.0:1788263307.461164:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+39:10368:x1875129735872896:12345-192.168.201.29@tcp:36:truncate.0 00010000:00010000:1.0:1788263307.461285:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263307.461322:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955f58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30ac expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.461345:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263307.461351:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263307.461634:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.461650:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.461678:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263307.461748:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788263307.461775:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9aedb12 reply state 0000000056ec7b0c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263307.461787:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263307.461937:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+41:10368:x1875129735872896:12345-192.168.201.29@tcp:36:truncate.0 Request processed in 774us (1195us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788263307.461945:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000020:00080000:1.0:1788263307.461951:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788263307.466587:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.466610:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.466620:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.466627:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263307.466633:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.466642:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.466664:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263307.466667:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263307.466692:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.466700:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263307.517238:0:8111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334304996833ns, next at 335304993410ns, rc = 0 00000100:00100000:2.0:1788263307.517354:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263307.517382:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753726976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263307.517478:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263307.517619:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753726976 00000100:00100000:0.0:1788263307.517630:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753726976 00000100:00100000:0.0:1788263307.517703:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788263307.517715:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753726976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263307.517759:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263307.517815:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753726976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263307.517823:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788263307.517923:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753726976:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788263307.648793:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788263307.648826:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000001:00080000:1.0:1788263307.648843:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:1.0:1788263307.648852:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788263307.648864:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99434f13f480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788263307.648869:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994346b8f200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99434f13f6c0 00000020:00080000:1.0:1788263307.648872:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994346b8f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994347c08400 00000020:00080000:1.0:1788263307.648946:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788263307.649086:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788263307.652822:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263307.652845:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753727104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788263307.652939:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263307.653026:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753727104 00000100:00100000:0.0:1788263307.653034:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753727104 00000100:00100000:0.0:1788263307.653080:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263307.653088:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875129753727104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788263307.653114:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788263307.653144:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a96bb89, atime: 0x6a96bb8a, ctime: 0x6a96bb89, blocks: 0x1 00010000:00010000:0.0:1788263307.653152:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653167:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1788263307.653172:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263307.653178:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653210:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653242:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653251:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653268:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788263307.653767:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3320:x1875129753727104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 677us (833us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788263307.653774:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788263307.653802:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263307.653809:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653817:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263307.653821:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653829:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653845:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653858:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513955f66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.653878:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263307.653881:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263307.653882:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788263307.653913:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994379f26d80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788263307.653919:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753727104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788263307.673404:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263307.673504:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735873024 00000100:00100000:3.0:1788263307.673514:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735873024 00000100:00100000:3.0:1788263307.673626:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:3.0:1788263307.673638:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+10:10382:x1875129735873024:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:3.0:1788263307.673663:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263307.673684:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513955f6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30b3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.673768:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.673782:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.673793:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.673807:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.673814:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.673821:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674123:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674132:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674139:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263307.674172:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788263307.674177:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263307.674201:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674263:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674273:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674279:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674286:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674291:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263307.674295:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674302:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674314:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:3.0:1788263307.674317:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263307.674322:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674328:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513955f74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674342:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674348:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674358:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674363:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263307.674366:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674371:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674379:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994352cd3b00) 00010000:00010000:3.0:1788263307.674381:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263307.674384:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674388:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955f7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674419:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513955f6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30b3 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674433:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30b3 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.674439:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263307.674441:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263307.674444:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ce00, rc 0) 00000100:00100000:3.0:1788263307.674570:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+11:10382:x1875129735873024:12345-192.168.201.29@tcp:101:stat.0 Request processed in 933us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263307.674587:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:3.0:1788263307.791772:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263307.792375:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735873280 00000100:00100000:1.0:1788263307.792391:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735873280 00000100:00100000:1.0:1788263307.792487:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1788263307.792501:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+11:10391:x1875129735873280:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263307.792531:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263307.792563:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30ba expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263307.792691:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788263307.793021:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f89 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30ba expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.793040:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:1.0:1788263307.793061:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263307.793068:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30ba expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.793083:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159c00, rc 0) 00000100:00100000:1.0:1788263307.793168:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+12:10391:x1875129735873280:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 670us (1411us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788263307.793177:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:0.0:1788263307.803307:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263307.803796:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735873536 00000100:00100000:3.0:1788263307.803808:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735873536 00000100:00100000:3.0:1788263307.803884:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1788263307.804350:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+12:10391:x1875129735873536:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1788263307.804610:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+13:10391:x1875129735873536:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 716us (1312us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788263307.804618:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1788263307.879124:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263307.879382:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735873792 00000100:00100000:1.0:1788263307.879392:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735873792 00000100:00100000:1.0:1788263307.879519:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:1.0:1788263307.879531:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+13:10398:x1875129735873792:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263307.879559:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263307.879581:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955f97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30c1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.879702:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.879718:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30b3 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.879727:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.879760:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30b3 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.879774:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30b3 expref: 14 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263307.879798:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753727232:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263307.880061:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263307.884120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263307.884549:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753727232:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263307.884575:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263307.884682:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735873920 00000100:00100000:0.0:1788263307.884689:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735873920 00010000:00010000:0.0:1788263307.884724:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30b3 expref: 15 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263307.884791:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:0.0:1788263307.884800:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+15:2362:x1875129735873920:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263307.884814:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263307.884821:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30b3 expref: 15 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.884833:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30b3 expref: 15 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.884855:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513955f82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30b3 expref: 15 pid: 5854 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.884902:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:0.0:1788263307.884908:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.884917:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.884924:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.884952:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263307.885020:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+14:2362:x1875129735873920:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 220us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263307.885027:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00010000:00010000:1.0:1788263307.886195:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.886208:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263307.886261:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788263307.888055:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955f97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c1 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.888083:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c1 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.888092:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263307.888095:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788263307.888404:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159c00, rc 0) 00000100:00100000:1.0:1788263307.889022:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+14:10398:x1875129735873792:12345-192.168.201.29@tcp:101:bash.0 Request processed in 9488us (9904us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788263307.889032:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:1.0:1788263307.893680:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263307.894403:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735874176 00000100:00100000:0.0:1788263307.894415:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735874176 00000100:00100000:0.0:1788263307.894484:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:0.0:1788263307.894495:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+14:10398:x1875129735874176:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:0.0:1788263307.894768:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.894787:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263307.894799:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788263307.894862:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788263307.894900:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054a00c44 reply state 00000000391d978d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263307.894923:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263307.895037:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+17:10398:x1875129735874176:12345-192.168.201.29@tcp:36:bash.0 Request processed in 544us (1366us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788263307.895044:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000020:00080000:0.0:1788263307.895049:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788263307.908191:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.908215:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.908279:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.908286:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263307.908292:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.908300:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.908323:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263307.908327:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263307.908333:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.908374:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513955fac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263307.912571:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263307.914935:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735874304 00000100:00100000:3.0:1788263307.914956:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735874304 00000100:00100000:3.0:1788263307.915062:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:3.0:1788263307.915075:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+16:10398:x1875129735874304:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788263307.915111:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263307.915142:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513955fb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30c8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.915288:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.915308:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c1 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.915318:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.916291:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c1 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263307.916317:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c1 expref: 17 pid: 5852 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263307.916335:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ef7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753727360:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263307.916442:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263307.921279:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263307.921543:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ef7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753727360:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263307.921579:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735874432 00010000:00010000:2.0:1788263307.921580:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263307.921595:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735874432 00010000:00010000:1.0:1788263307.921667:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c1 expref: 18 pid: 5852 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263307.921724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1788263307.921735:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+18:2361:x1875129735874432:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263307.921749:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263307.921757:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c1 expref: 18 pid: 5852 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.921770:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c1 expref: 18 pid: 5852 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.921795:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955f9e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c1 expref: 18 pid: 5852 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.921817:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263307.921822:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.921831:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.921838:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263307.921885:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263307.921960:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+17:2361:x1875129735874432:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 226us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263307.921967:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00010000:00010000:3.0:1788263307.922255:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.922267:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263307.922518:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788263307.922524:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263307.922555:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.922614:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513955fb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c8 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.922638:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c8 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263307.922650:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263307.922653:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263307.922657:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d000, rc 0) 00000100:00100000:3.0:1788263307.922730:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+16:10398:x1875129735874304:12345-192.168.201.29@tcp:101:bash.0 Request processed in 7657us (10169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263307.922740:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:0.0:1788263307.927493:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263307.930326:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735874688 00000100:00100000:2.0:1788263307.930407:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735874688 00000100:00100000:2.0:1788263307.930540:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1788263307.930555:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+16:10398:x1875129735874688:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:2.0:1788263307.930904:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+17:10398:x1875129735874688:12345-192.168.201.29@tcp:35:bash.0 Request processed in 342us (3414us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788263307.930929:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1788263308.030361:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753727488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263308.030470:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263308.031028:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753727488 00000100:00100000:1.0:1788263308.031039:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753727488 00000100:00100000:1.0:1788263308.031111:0:11722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788263308.031123:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753727488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263308.031161:0:11722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263308.031287:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753727488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263308.031296:0:11722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788263308.031357:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753727488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263308.044743:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263308.045768:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735874944 00000100:00100000:1.0:1788263308.045784:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735874944 00000100:00100000:1.0:1788263308.045859:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1788263308.045872:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+17:10408:x1875129735874944:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263308.045919:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263308.045948:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955fc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30cf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263308.046106:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788263308.046304:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955fc1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30cf expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.046323:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:1.0:1788263308.046326:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263308.046331:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513955fc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30cf expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.046344:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159c00, rc 0) 00000100:00100000:0.0:1788263308.046526:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+18:10408:x1875129735874944:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 653us (1793us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788263308.046535:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:0.0:1788263308.050341:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263308.050834:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735875072 00000100:00100000:1.0:1788263308.050846:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735875072 00000100:00100000:1.0:1788263308.050937:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:1.0:1788263308.050949:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+18:10408:x1875129735875072:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:1.0:1788263308.051067:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051088:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051103:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051122:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051130:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051136:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051492:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051500:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051506:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263308.051551:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051564:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051573:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051578:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051582:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263308.051586:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051591:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051601:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:1.0:1788263308.051603:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263308.051606:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051610:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513955fcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051620:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051624:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051628:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051630:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263308.051636:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051640:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051645:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9943565b5400) 00010000:00010000:1.0:1788263308.051646:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263308.051647:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051650:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513955fd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051660:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051663:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051666:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051669:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263308.051670:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051674:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051678:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263308.051679:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263308.051684:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.051688:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513955fdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263308.051770:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+18:10408:x1875129735875072:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 821us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263308.051778:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:3.0:1788263308.054955:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263308.057385:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735875328 00000100:00100000:1.0:1788263308.057406:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735875328 00000100:00100000:1.0:1788263308.057492:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788263308.057505:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+18:10408:x1875129735875328:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788263308.057817:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+19:10408:x1875129735875328:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 313us (2880us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788263308.057825:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788263308.099480:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263308.099604:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735875584 00000100:00100000:2.0:1788263308.099617:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735875584 00000100:00100000:2.0:1788263308.099693:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:2.0:1788263308.099706:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+19:10411:x1875129735875584:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263308.099739:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263308.099767:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955fe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30d6 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.099866:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.099883:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.099908:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.099925:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.099933:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.099939:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100612:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100637:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100647:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263308.100661:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788263308.100786:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100794:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100801:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100808:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263308.100813:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100821:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100837:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263308.100841:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263308.100847:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100854:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513955feb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100868:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100883:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.100889:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.101156:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263308.101160:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.101167:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.101177:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99434314f600) 00010000:00010000:2.0:1788263308.101180:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263308.101183:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.101189:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513955ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.101418:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513955fe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30d6 expref: 22 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.101436:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30d6 expref: 21 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.101444:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263308.101448:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263308.101458:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6e00, rc 0) 00000100:00100000:2.0:1788263308.101542:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+21:10411:x1875129735875584:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1837us (2076us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788263308.101551:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:0.0:1788263308.104581:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263308.104688:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263308.104875:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735875840 00000100:00100000:2.0:1788263308.104888:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735875840 00000100:00100000:2.0:1788263308.105193:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:2.0:1788263308.105210:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+21:10411:x1875129735875840:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1788263308.105323:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.105342:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.105354:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.105388:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.105395:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.105402:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.105409:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263308.105414:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.105423:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.105459:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263308.105462:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263308.105467:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.105474:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956007 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263308.105729:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+21:10411:x1875129735875840:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 523us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.105738:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1788263308.105921:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735875712 00000100:00100000:1.0:1788263308.105929:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735875712 00000100:00100000:1.0:1788263308.106160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:1.0:1788263308.106171:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+21:2361:x1875129735875712:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263308.106188:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263308.106209:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513955ff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30d6 expref: 21 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263308.106239:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263308.106243:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263308.106272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+20:2361:x1875129735875712:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 104us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263308.106291:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788263308.108936:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263308.109069:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735876096 00000100:00100000:0.0:1788263308.109082:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735876096 00000100:00100000:0.0:1788263308.109152:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788263308.109164:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+20:10411:x1875129735876096:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788263308.109529:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+21:10411:x1875129735876096:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 365us (605us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788263308.109537:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788263308.227397:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263308.227532:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735876352 00000100:00100000:2.0:1788263308.227546:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735876352 00000100:00100000:2.0:1788263308.227620:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1788263308.227633:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+21:10429:x1875129735876352:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:2.0:1788263308.227668:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263308.227694:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc51395600e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.227865:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956015 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.227882:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956015 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.227907:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956015 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263308.227922:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788263308.228122:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc51395600e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30dd expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.228147:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956015 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30dd expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.228157:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263308.228160:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788263308.228164:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6c00, rc 0) 00000100:00100000:2.0:1788263308.228309:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+23:10429:x1875129735876352:12345-192.168.201.29@tcp:101:cat.0 Request processed in 678us (926us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788263308.228317:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1788263308.254543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263308.254642:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735876480 00000100:00100000:3.0:1788263308.254656:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735876480 00000100:00100000:3.0:1788263308.254732:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:3.0:1788263308.254745:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+23:10430:x1875129735876480:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263308.254780:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263308.254810:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30e4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263308.255179:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc51395602a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263308.255200:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc51395602a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263308.255214:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc51395602a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263308.255302:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788263308.255306:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263308.255329:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc51395602a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263308.255365:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30e4 expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263308.255388:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc51395602a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30e4 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263308.255399:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:3.0:1788263308.255402:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263308.255407:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d800, rc 0) 00000100:00100000:3.0:1788263308.255486:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+24:10430:x1875129735876480:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 744us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263308.255495:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:3.0:1788263308.263903:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263308.264073:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735876864 00000100:00100000:0.0:1788263308.264089:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735876864 00000100:00100000:0.0:1788263308.264170:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788263308.264206:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+24:10430:x1875129735876864:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788263308.264708:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+25:10430:x1875129735876864:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 503us (829us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788263308.264717:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788263308.268305:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263308.268457:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735876992 00000100:00100000:3.0:1788263308.268490:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735876992 00000100:00100000:3.0:1788263308.268578:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263308.268592:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+25:10430:x1875129735876992:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:3.0:1788263308.268614:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788263308.268649:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513955fba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30c8 expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263308.268676:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956015 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30dd expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263308.268688:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513955ebe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3089 expref: 23 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263308.268701:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263308.268715:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263308.268798:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+22:10430:x1875129735876992:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 208us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263308.268807:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1788263308.271399:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263308.271515:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735877120 00000100:00100000:0.0:1788263308.271528:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735877120 00000100:00100000:0.0:1788263308.271611:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:0.0:1788263308.271624:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+22:10430:x1875129735877120:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:0.0:1788263308.271775:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263308.271796:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263308.271809:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263308.273263:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263308.273498:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788263308.273578:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788263308.273739:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+22:10430:x1875129735877120:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 2110us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263308.273753:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:0.0:1788263308.299709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263308.299827:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735877248 00000100:00100000:2.0:1788263308.299842:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735877248 00000100:00100000:2.0:1788263308.300268:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:2.0:1788263308.300285:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+22:10432:x1875129735877248:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263308.300319:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263308.300350:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956038 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30eb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.300447:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.300466:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.300480:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.300524:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.300532:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.300540:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.300871:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.300881:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.300910:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263308.300960:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788263308.300965:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263308.301019:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301035:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301045:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301053:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301073:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301079:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263308.301085:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301094:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301109:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263308.301112:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263308.301118:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301126:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395603f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301144:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301150:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301157:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301162:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263308.301165:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301182:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301192:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99434314f600) 00010000:00010000:2.0:1788263308.301194:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263308.301197:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301203:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301304:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956038 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30eb expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301321:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30eb expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263308.301329:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994344cab400) 00010000:00010000:2.0:1788263308.301331:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263308.301334:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6c00, rc 0) 00000100:00100000:2.0:1788263308.301437:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+23:10432:x1875129735877248:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1156us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.301446:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00010000:00010000:0.0:1788263308.475504:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263309.053442:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263309.053453:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263309.053517:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788263309.053525:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788263309.053653:0:11704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753727616:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263309.053757:0:11704:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263309.066516:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263309.066609:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735877376 00000100:00100000:1.0:1788263309.066619:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735877376 00000100:00100000:1.0:1788263309.066692:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:1.0:1788263309.066704:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fedef325-db54-4469-b29a-301ff58466df+24:10443:x1875129735877376:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788263309.066793:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fedef325-db54-4469-b29a-301ff58466df+24:10443:x1875129735877376:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.066801:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:1.0:1788263309.066936:0:11704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753727616:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1788263309.067192:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788263309.067887:0:12021:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263309.067894:0:12021:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263309.067929:0:12021:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788263309.067936:0:12021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788263309.081650:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263309.085575:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735877504 00000100:00100000:2.0:1788263309.085589:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735877504 00000100:00100000:2.0:1788263309.085644:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:2.0:1788263309.085653:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+23:10443:x1875129735877504:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788263309.085692:0:6725:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788263309.085798:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+23:10443:x1875129735877504:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 145us (4158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263309.085805:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:1.0:1788263309.092931:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263309.093014:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735877632 00000100:00100000:3.0:1788263309.093024:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735877632 00000100:00100000:3.0:1788263309.093095:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1788263309.093106:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+23:10443:x1875129735877632:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788263309.093192:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093479:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093495:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093513:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093521:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093527:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093556:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093564:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093571:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263309.093617:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788263309.093623:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263309.093639:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093651:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093666:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093673:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093679:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263309.093683:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093690:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093701:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:3.0:1788263309.093704:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263309.093708:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093713:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956054 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093725:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093730:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093735:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093739:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263309.093747:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093754:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093762:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff994352cd3200) 00010000:00010000:3.0:1788263309.093765:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263309.093768:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093773:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395605b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093789:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093795:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093800:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093806:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263309.093809:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093815:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093822:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994344cab400) 00010000:00010000:3.0:1788263309.093824:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263309.093833:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.093838:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956062 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263309.093960:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+23:10443:x1875129735877632:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 854us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263309.093968:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:2.0:1788263309.107996:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.108436:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735877888 00000100:00100000:0.0:1788263309.108449:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735877888 00000100:00100000:0.0:1788263309.108513:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:0.0:1788263309.108525:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+23:10443:x1875129735877888:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263309.108546:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263309.108567:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956069 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30f2 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.108669:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.108684:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.108696:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263309.108708:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788263309.108807:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.108814:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.108821:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.108828:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263309.108833:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.108856:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.108868:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994344cab400) 00010000:00010000:0.0:1788263309.108871:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263309.109034:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.109041:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.109154:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956069 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30f2 expref: 25 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.109165:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:0.0:1788263309.109168:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263309.109171:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956069 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30f2 expref: 25 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.109192:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658e00, rc 0) 00000100:00100000:0.0:1788263309.109668:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+24:10443:x1875129735877888:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1142us (1691us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788263309.109677:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:3.0:1788263309.126263:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.126363:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735878016 00000100:00100000:0.0:1788263309.126374:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735878016 00000100:00100000:0.0:1788263309.126440:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:0.0:1788263309.126451:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+24:10443:x1875129735878016:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788263309.126515:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788263309.126641:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+24:10443:x1875129735878016:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 191us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.126649:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:0.0:1788263309.146415:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263309.146508:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735878272 00000100:00100000:3.0:1788263309.146519:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735878272 00000100:00100000:3.0:1788263309.146593:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:3.0:1788263309.146604:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+24:10443:x1875129735878272:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263309.146626:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263309.146629:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788263309.146660:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc51395602a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30e4 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.146679:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:3.0:1788263309.146685:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263309.146698:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc51395607e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d30f9 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263309.147366:0:6725:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788263309.147635:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956085 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.147651:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.147670:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.147735:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc51395607e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30f9 expref: 26 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.147752:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30f9 expref: 25 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.147761:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994352cd3200) 00010000:00010000:3.0:1788263309.147764:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263309.147767:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d000, rc 0) 00000100:00100000:3.0:1788263309.147842:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+25:10443:x1875129735878272:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1239us (1438us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788263309.147852:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:2.0:1788263309.156712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263309.156763:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735878528 00000100:00100000:1.0:1788263309.156773:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735878528 00000100:00100000:1.0:1788263309.156837:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:1.0:1788263309.156848:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+25:10443:x1875129735878528:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788263309.157028:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263309.157069:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956085 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30f9 expref: 25 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157087:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994352cd3200) 00010000:00010000:1.0:1788263309.157106:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263309.157131:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157144:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157154:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157203:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157211:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157236:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157463:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157471:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157478:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157485:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263309.157489:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157496:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157512:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:1.0:1788263309.157515:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263309.157519:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157525:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956093 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157535:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157540:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157546:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157551:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263309.157553:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157559:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157565:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcfb360f1 (ffff9943565b5400) 00010000:00010000:1.0:1788263309.157567:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263309.157569:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.157575:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc51395609a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcfb360f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263309.158370:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+24:10443:x1875129735878528:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1518us (1663us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263309.158379:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:0.0:1788263309.161830:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263309.161904:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735878656 00000100:00100000:1.0:1788263309.161914:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735878656 00000100:00100000:1.0:1788263309.162004:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:1.0:1788263309.162017:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+24:10443:x1875129735878656:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263309.162038:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263309.162062:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139560a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3100 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.162099:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.162140:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.162153:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.162264:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139560a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3100 expref: 26 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.162282:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3100 expref: 25 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.162291:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:1.0:1788263309.162300:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788263309.162305:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159a00, rc 0) 00000100:00100000:1.0:1788263309.162371:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+25:10443:x1875129735878656:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 357us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.162379:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:1.0:1788263309.168965:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263309.169056:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735878912 00000100:00100000:3.0:1788263309.169067:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735878912 00000100:00100000:3.0:1788263309.169128:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:3.0:1788263309.169138:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+25:10443:x1875129735878912:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263309.169262:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.169279:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.169290:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263309.169613:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788263309.169623:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335957404901ns, next at 336957402603ns, rc = 0 00000004:00010000:3.0:1788263309.169712:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068adfae2 reply state 000000005f04f70c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263309.169723:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263309.170048:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+27:10443:x1875129735878912:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 908us (1088us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788263309.170056:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00010000:00010000:1.0:1788263309.176854:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.176872:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.176879:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.176885:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263309.176891:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.176899:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.176918:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:1.0:1788263309.176921:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788263309.176926:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.176932:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139560af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263309.182368:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263309.182427:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735879040 00000100:00100000:2.0:1788263309.182435:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735879040 00000100:00100000:2.0:1788263309.182481:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:2.0:1788263309.182491:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+26:10443:x1875129735879040:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263309.182514:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263309.182544:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3107 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.182598:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3107 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.182613:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3107 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.182630:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:2.0:1788263309.182633:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263309.182637:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6e00, rc 0) 00000100:00100000:2.0:1788263309.182693:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+27:10443:x1875129735879040:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 203us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263309.182710:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:1.0:1788263309.203033:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.209443:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735879168 00000100:00100000:0.0:1788263309.209458:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735879168 00000100:00100000:0.0:1788263309.209601:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788263309.209610:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875129735879168:12345-192.168.201.29@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788263309.209640:0:8112:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:0.0:1788263309.209677:0:8112:0:(genops.c:1385:class_connect()) connect: client fedef325-db54-4469-b29a-301ff58466df, cookie 0x1a657bc5139560bd 00002000:00100000:0.0:1788263309.209688:0:8112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fedef325-db54-4469-b29a-301ff58466df/ffff99434646d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788263309.209698:0:8112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788263309.210054:0:8112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788263309.210095:0:8112:0:(import.c:65:import_set_state_nolock()) ffff994346468800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263309.210239:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:2358:x1875129735879168:12345-192.168.201.29@tcp:8:lhsmtool_posix.0 Request processed in 604us (7192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.210248:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1788263309.215610:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.215822:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735879296 00000100:00100000:0.0:1788263309.215834:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735879296 00000100:00100000:0.0:1788263309.215916:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:0.0:1788263309.215928:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+6:0:x1875129735879296:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788263309.216379:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788263309.303199:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788263309.303269:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000100:00100000:0.0:1788263309.303699:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+5:0:x1875129735879296:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 87768us (88093us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788263309.303724:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:2.0:1788263309.310036:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.310131:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735879552 00000100:00100000:0.0:1788263309.310141:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735879552 00000100:00100000:0.0:1788263309.310242:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:0.0:1788263309.310254:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+27:10443:x1875129735879552:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788263309.310498:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+28:10443:x1875129735879552:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 245us (470us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788263309.310505:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1788263309.314713:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.316563:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735879808 00000100:00100000:0.0:1788263309.316577:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735879808 00000100:00100000:0.0:1788263309.316650:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:0.0:1788263309.316662:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+28:10443:x1875129735879808:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788263309.316816:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+28:10443:x1875129735879808:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 156us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.316824:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1788263309.329169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.329438:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735879936 00000100:00100000:0.0:1788263309.329449:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735879936 00000100:00100000:0.0:1788263309.329630:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1788263309.329642:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+28:10443:x1875129735879936:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263309.329664:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263309.329686:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139560c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d310e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.329760:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc5139560cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.329792:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc5139560cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.329804:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc5139560cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263309.329843:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263309.329869:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc5139560cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.329890:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139560c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d310e expref: 30 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.329907:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc5139560cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d310e expref: 29 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.329916:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:0.0:1788263309.329919:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788263309.329923:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659a00, rc 0) 00000100:00100000:0.0:1788263309.330003:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+29:10443:x1875129735879936:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 364us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.330011:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:3.0:1788263309.338705:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.338806:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735880064 00000100:00100000:0.0:1788263309.338816:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735880064 00000100:00100000:0.0:1788263309.338914:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1788263309.338925:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735880064:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263309.338945:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263309.338992:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3115 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263309.339024:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bb8c, blocks: 0x1 00010000:00010000:0.0:1788263309.339047:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1788263309.339052:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263309.339061:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3115 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.339080:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3115 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.339094:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659e00, rc 0) 00000100:00100000:0.0:1788263309.339204:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735880064:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 280us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.339210:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1788263309.345634:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263309.345870:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735880320 00000100:00100000:1.0:1788263309.345879:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735880320 00000100:00100000:1.0:1788263309.345943:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:1.0:1788263309.345954:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+29:10443:x1875129735880320:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788263309.346091:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+29:10443:x1875129735880320:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 137us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.346099:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:1.0:1788263309.352441:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263309.355101:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735880448 00000100:00100000:2.0:1788263309.355118:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735880448 00000100:00100000:3.0:1788263309.355363:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1788263309.355376:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:10443:x1875129735880448:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263309.355398:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263309.355420:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d311c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.355452:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3115 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.355462:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263309.355467:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263309.355471:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.355508:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3115 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.355539:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3115 expref: 7 pid: 6704 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263309.355556:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1875129753727744:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263309.355670:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346507900 going to sleep for 11 seconds 00000100:00100000:0.0:1788263309.360583:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1875129753727744:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263309.360626:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.360647:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d200, rc 0) 00000100:00100000:0.0:1788263309.361507:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:10443:x1875129735880448:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 6127us (9071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.361518:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:0.0:1788263309.365076:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263309.365483:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735880576 00000100:00100000:2.0:1788263309.365498:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735880576 00010000:00010000:2.0:1788263309.365561:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3115 expref: 7 pid: 6704 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263309.365607:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:2.0:1788263309.365619:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735880576:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263309.365634:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263309.365658:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3115 expref: 7 pid: 6704 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.365673:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3115 expref: 7 pid: 6704 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.365696:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3beaead/0x1a657bc5139560d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3115 expref: 7 pid: 6704 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.365715:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263309.365720:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263309.365745:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.365755:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.365796:0:8471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263309.365811:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8471:1875129753727872:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788263309.365905:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263309.375383:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8471:1875129753727872:192.168.201.29@tcp:105: 00010000:00010000:1.0:1788263309.375420:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263309.375496:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc93050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735880576:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 9878us (10428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.375508:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1788263309.376742:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.376951:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735880704 00000100:00100000:0.0:1788263309.376963:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735880704 00002000:00100000:0.0:1788263309.377023:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9943755a9c00 x1875129735880704/t0(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:520/0 lens 504/0 e 0 to 0 dl 1788263320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263309.377034:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9943755a9c00 with x1875129735880704 ext(0->8) 00002000:00010000:0.0:1788263309.377039:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9943755a9c00 00000100:00100000:0.0:1788263309.377136:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788263309.377146:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735880704:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788263309.377861:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735880704:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 714us (1129us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788263309.377871:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00002000:00100000:0.0:1788263309.377879:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9943755a9c00 x1875129735880704/t4294967302(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:520/0 lens 504/448 e 0 to 0 dl 1788263320 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263309.377888:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9943755a9c00 with x1875129735880704 ext(0->8) 00002000:00010000:0.0:1788263309.377892:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9943755a9c00 00000100:00100000:0.0:1788263309.386475:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263309.390617:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735880832 00000100:00100000:2.0:1788263309.390633:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735880832 00000100:00100000:0.0:1788263309.392156:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1788263309.392182:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+29:10443:x1875129735880832:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788263309.472737:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1788263309.472962:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788263309.473086:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788263309.473102:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788263309.474283:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+16:10443:x1875129735880832:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 82103us (87807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.474300:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000004:00080000:3.0:1788263309.479099:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1788263309.479419:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263309.480166:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735880960 00000100:00100000:2.0:1788263309.480181:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735880960 00000100:00100000:2.0:1788263309.480320:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788263309.480333:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735880960:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788263309.481854:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263309.490379:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753728000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788263309.490579:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263309.490676:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753728000 00000100:00100000:3.0:1788263309.490685:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753728000 00000100:00100000:3.0:1788263309.490755:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788263309.490766:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753728000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788263309.491063:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788263309.491067:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788263309 00002000:00010000:3.0:1788263309.491070:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788263309.491072:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788263308 -> 1788263309 00002000:00010000:3.0:1788263309.491075:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788263309.491127:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753728000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 361us (547us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788263309.491136:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788263309.491166:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788263309.491242:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994381291880/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788263309.491251:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753728000:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788263309.500055:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263309.545160:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.545262:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.545303:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263309.545813:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735881088 00000100:00100000:3.0:1788263309.545829:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735881088 00000100:00100000:3.0:1788263309.545918:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 280 00000100:00100000:3.0:1788263309.545930:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735881088:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263309.546027:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735881088:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 99us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263309.546037:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 280 00000100:00100000:3.0:1788263309.546080:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735881344 00000100:00100000:3.0:1788263309.546085:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735881344 00000100:00100000:3.0:1788263309.546131:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1788263309.546139:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735881344:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263309.546174:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735881344:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263309.546181:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00080000:3.0:1788263309.546200:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263309.547151:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735881216 00000100:00100000:1.0:1788263309.547163:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735881216 00000100:00100000:1.0:1788263309.547268:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:1.0:1788263309.547280:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735881216:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263309.547378:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735881216:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 102us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.547386:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00080000:3.0:1788263309.547801:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263309.567806:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735880960:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 87457us (88376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263309.567825:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000001:00080000:1.0:1788263309.570923:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788263309.571677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263309.571777:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735881600 00000100:00100000:2.0:1788263309.571790:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735881600 00000100:00100000:2.0:1788263309.571864:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:2.0:1788263309.572091:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+13:10443:x1875129735881600:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788263309.572161:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263309.572197:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc5139560cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d310e expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.572409:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:2.0:1788263309.572415:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263309.572528:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.572544:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.572555:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263309.573088:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff7a0984 reply state 00000000445bdc38 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263309.573101:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263309.573416:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+14:10443:x1875129735881600:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1327us (1745us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788263309.573425:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:0.0:1788263309.577642:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263309.578030:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735881728 00000100:00100000:1.0:1788263309.578044:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735881728 00000100:00100000:1.0:1788263309.578120:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1788263309.578134:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735881728:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788263309.578570:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788263309.578575:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788263309 -> 1788263307 00002000:00010000:1.0:1788263309.578578:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788263306 00002000:00010000:1.0:1788263309.578580:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788263309 -> 1788263307 00002000:00010000:1.0:1788263309.578582:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788263309.578668:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735881728:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 533us (1037us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788263309.578678:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00010000:00010000:3.0:1788263309.579775:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.579791:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.579798:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.579805:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263309.579830:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.579840:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.579863:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:3.0:1788263309.579867:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263309.579886:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.579893:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139560e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263309.582299:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263309.582624:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735881984 00000100:00100000:3.0:1788263309.582638:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735881984 00000100:00100000:3.0:1788263309.582716:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1788263309.582730:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+13:10443:x1875129735881984:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788263309.582832:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.582854:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3100 expref: 13 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.582865:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.582926:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3100 expref: 13 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.582942:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3100 expref: 13 pid: 6725 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263309.582987:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753728128:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263309.583119:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943465070c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263309.587133:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753728128:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263309.587173:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263309.588630:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.589029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735882112 00000100:00100000:0.0:1788263309.589062:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735882112 00010000:00010000:0.0:1788263309.589117:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3100 expref: 14 pid: 6725 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263309.589172:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1788263309.589184:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+14:2362:x1875129735882112:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263309.589205:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263309.589214:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3100 expref: 14 pid: 6725 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.589283:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3100 expref: 14 pid: 6725 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.589310:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139560a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3100 expref: 14 pid: 6725 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.589331:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:0.0:1788263309.589337:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.589348:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.589357:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.589394:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263309.589485:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+13:2362:x1875129735882112:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 301us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.589502:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00010000:00010000:1.0:1788263309.590484:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.590499:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.590541:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.590549:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.590572:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.590579:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263309.590584:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.590593:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.590611:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:1.0:1788263309.590615:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788263309.590619:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.590626:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139560e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263309.590727:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+12:10443:x1875129735881984:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 7996us (8439us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788263309.590737:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:1.0:1788263309.595014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.595106:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735882240 00000100:00100000:0.0:1788263309.595121:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735882240 00000100:00100000:0.0:1788263309.595204:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:0.0:1788263309.595266:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735882240:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788263309.595329:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.595356:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.595366:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263309.595370:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263309.595375:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.595421:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.595447:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 7 pid: 6702 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263309.595469:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381290000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875129753728256:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263309.595579:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263309.600057:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263309.600166:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735882368 00000100:00100000:1.0:1788263309.600179:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735882368 00010000:00010000:1.0:1788263309.600271:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 8 pid: 6702 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263309.600318:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1788263309.600330:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+8:2361:x1875129735882368:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263309.600369:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263309.600399:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 8 pid: 6702 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.600417:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 8 pid: 6702 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.600460:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263309.600466:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263309.600473:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.600485:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.600508:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263309.600582:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+8:2361:x1875129735882368:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 253us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.600591:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00010000:00010000:0.0:1788263309.601287:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b4a8482/0x1a657bc5139560d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d311c expref: 7 pid: 6702 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263309.601323:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381290000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875129753728256:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263309.601352:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.601365:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.601374:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.601409:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.601419:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.601429:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.601503:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263309.601509:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.601519:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.601545:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.601553:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc5139560ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263309.601638:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735882240:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 6422us (6638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.601648:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:2.0:1788263309.605087:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263309.605204:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735882624 00000100:00100000:1.0:1788263309.605259:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735882624 00000100:00100000:1.0:1788263309.605334:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:1.0:1788263309.605347:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+12:10443:x1875129735882624:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788263309.605589:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.605613:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.605646:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.611512:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.611551:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3107 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.611562:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.611620:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3107 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.611641:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3107 expref: 13 pid: 5853 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263309.611660:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753728384:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263309.611855:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263309.616361:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753728384:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263309.616403:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263309.618837:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263309.619730:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735882752 00000100:00100000:1.0:1788263309.619747:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735882752 00010000:00010000:1.0:1788263309.619810:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3107 expref: 14 pid: 5853 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263309.619904:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:1.0:1788263309.619916:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+14:2362:x1875129735882752:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263309.619950:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263309.619959:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3107 expref: 14 pid: 5853 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.619989:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3107 expref: 14 pid: 5853 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.620019:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139560b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3107 expref: 14 pid: 5853 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.620041:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:1.0:1788263309.620047:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.620058:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.620065:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263309.620105:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263309.620177:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380630e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+13:2362:x1875129735882752:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 263us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.620186:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00010000:00010000:3.0:1788263309.620410:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.620420:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263309.620674:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788263309.620847:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788263309.620893:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788263309.621019:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6725:1875129753728512:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788263309.621095:0:6725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263309.621138:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346507480 going to sleep for 11 seconds 00000100:00100000:1.0:1788263309.621620:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753728512 00000100:00100000:1.0:1788263309.621642:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753728512 00000100:00100000:1.0:1788263309.621707:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263309.621716:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6725:x1875129753728512:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788263309.621812:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6725:x1875129753728512:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.621820:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263309.623511:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6725:1875129753728512:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788263309.624184:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788263309.624326:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6725:1875129753728640:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788263309.624418:0:6725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263309.624458:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943465070c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263309.625094:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753728640 00000100:00100000:1.0:1788263309.625105:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753728640 00000100:00100000:1.0:1788263309.625175:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263309.625186:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6725:x1875129753728640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788263309.625512:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6725:x1875129753728640:12345-0@lo:1000:mdt00_003.0 Request processed in 326us (1093us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788263309.625521:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263309.625786:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6725:1875129753728640:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788263309.625837:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.625851:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.625859:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.625890:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263309.625896:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.625904:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.625925:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9943565b5a00) 00010000:00010000:2.0:1788263309.625939:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263309.625945:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.625952:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139560fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626013:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626022:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626029:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626033:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263309.626036:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626042:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626063:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994344cab400) 00010000:00010000:2.0:1788263309.626066:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263309.626069:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626074:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956031 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626102:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626120:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30eb expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626130:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626173:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30eb expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.626191:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30eb expref: 16 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263309.626207:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380631500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753728768:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263309.626352:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263309.631114:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380631500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753728768:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263309.631162:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263309.634789:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.634905:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735882880 00000100:00100000:0.0:1788263309.634919:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735882880 00010000:00010000:0.0:1788263309.634992:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30eb expref: 17 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263309.635048:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:0.0:1788263309.635061:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+17:2361:x1875129735882880:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263309.635079:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263309.635088:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30eb expref: 17 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.635105:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30eb expref: 17 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.635136:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395604d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d30eb expref: 17 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.635180:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994344cab400) 00010000:00010000:0.0:1788263309.635187:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.635198:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.635207:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.635650:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263309.635814:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635826:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635841:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635848:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635856:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635862:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263309.635867:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635876:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635889:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994344cab400) 00010000:00010000:3.0:1788263309.635892:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263309.635896:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635901:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956103 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635938:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635945:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635952:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635958:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263309.635961:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635981:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.635990:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994344cab400) 00010000:00010000:3.0:1788263309.635992:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263309.635995:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263309.636001:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139560f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263309.636612:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+16:10443:x1875129735882624:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 31259us (31532us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788263309.636625:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000020:00080000:3.0:1788263309.636631:0:6725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788263309.636991:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263309.636998:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263309.637032:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788263309.637040:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788263309.638433:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+15:2361:x1875129735882880:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 3348us (3633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.638449:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:2.0:1788263309.644089:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263309.644209:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735883136 00000100:00100000:0.0:1788263309.644347:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735883136 00000100:00100000:0.0:1788263309.644461:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788263309.644475:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+15:10443:x1875129735883136:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788263309.645511:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788263309.645658:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788263309.645726:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.645747:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.645761:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.645780:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.645787:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.645794:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263309.645907:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788263309.646213:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+17:10443:x1875129735883136:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1737us (2137us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788263309.646242:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000020:00080000:0.0:1788263309.646249:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788263309.646785:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263309.646796:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.646820:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263309.646824:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.646834:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.646853:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff994344cab000) 00010000:00010000:2.0:1788263309.646856:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788263309.646862:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.647056:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395610a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263309.647084:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263309.647086:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263309.647088:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263310.531454:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263311.152091:0:12074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263311.152105:0:12074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263311.152146:0:12074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788263311.152153:0:12074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263311.334669:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263311.335440:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735883392 00000100:00100000:1.0:1788263311.335454:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735883392 00000100:00100000:1.0:1788263311.335534:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:1.0:1788263311.335547:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+17:10463:x1875129735883392:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263311.335579:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263311.335604:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3123 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.335741:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513956118 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.335757:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513956118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.335772:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513956118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263311.335783:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788263311.335920:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3123 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.335951:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513956118 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3123 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.335961:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:1.0:1788263311.335964:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788263311.335967:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158c00, rc 0) 00000100:00100000:1.0:1788263311.336039:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+19:10463:x1875129735883392:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 495us (1383us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788263311.336047:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00080000:3.0:1788263311.336525:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263311.346974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263311.352600:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735883520 00000100:00100000:2.0:1788263311.352620:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735883520 00000100:00100000:2.0:1788263311.353149:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:2.0:1788263311.353166:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:10463:x1875129735883520:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:2.0:1788263311.353312:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353347:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353361:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353398:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353406:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353413:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353727:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353736:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353744:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263311.353794:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353808:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353814:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353821:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353827:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263311.353832:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353847:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353860:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263311.353864:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263311.353869:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353875:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353888:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353894:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353900:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353905:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263311.353908:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353913:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353919:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99434314fa00) 00010000:00010000:2.0:1788263311.353921:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263311.353924:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353952:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395612d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353966:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353973:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353979:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353984:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263311.353987:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.353993:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.354001:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99434314f600) 00010000:00010000:2.0:1788263311.354003:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263311.354005:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.354010:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263311.354121:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:10463:x1875129735883520:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 957us (7160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263311.354132:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:1.0:1788263311.464535:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263311.464682:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735883776 00000100:00100000:3.0:1788263311.464696:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735883776 00000100:00100000:3.0:1788263311.464774:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1788263311.464787:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+19:10466:x1875129735883776:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263311.464816:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263311.464844:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395613b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d312a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.464953:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.464974:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.464987:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.465003:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.465010:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.465016:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466296:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466314:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466340:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263311.466354:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788263311.466476:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466481:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466487:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466491:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263311.466494:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466499:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466511:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:3.0:1788263311.466513:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263311.466516:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466519:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956142 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466530:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466533:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466542:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466545:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263311.466547:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466550:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466555:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994352cd3300) 00010000:00010000:3.0:1788263311.466556:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263311.466558:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466573:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466618:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395613b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d312a expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466630:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d312a expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.466635:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:3.0:1788263311.466636:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263311.466638:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216de00, rc 0) 00000100:00100000:3.0:1788263311.466719:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+21:10466:x1875129735883776:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1934us (2201us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788263311.466737:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:0.0:1788263311.473555:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263311.473705:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735883904 00000100:00100000:3.0:1788263311.473719:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735883904 00000100:00100000:3.0:1788263311.473791:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:3.0:1788263311.473802:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+21:10466:x1875129735883904:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1788263311.482199:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.482265:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.482281:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.482320:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.482328:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.482334:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.482341:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263311.482346:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.482354:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.482376:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:2.0:1788263311.482380:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263311.482386:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.482392:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395615e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263311.482514:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+21:10466:x1875129735883904:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 8696us (8957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263311.482544:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:0.0:1788263311.485058:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263311.485114:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735884160 00000100:00100000:3.0:1788263311.485128:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735884160 00000100:00100000:1.0:1788263311.485327:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788263311.485343:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2ca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+21:10466:x1875129735884160:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788263311.486121:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2ca450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+22:10466:x1875129735884160:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 780us (1075us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788263311.486153:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788263311.535027:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263311.535131:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735884416 00000100:00100000:0.0:1788263311.535144:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735884416 00000100:00100000:0.0:1788263311.535469:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:0.0:1788263311.535484:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+22:9985:x1875129735884416:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788263311.535531:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263311.535561:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956165 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3131 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.535709:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.535726:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d312a expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.535753:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.535794:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d312a expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.535809:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d312a expref: 23 pid: 5854 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263311.535825:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381291180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753728896:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263311.535943:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263311.545029:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381291180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753728896:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263311.545072:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.547427:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263311.548277:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263311.550946:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735884544 00000100:00100000:2.0:1788263311.550972:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735884544 00010000:00010000:2.0:1788263311.551047:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d312a expref: 24 pid: 5854 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263311.551111:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:2.0:1788263311.551124:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+24:2362:x1875129735884544:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263311.551144:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263311.551150:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d312a expref: 24 pid: 5854 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.551162:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d312a expref: 24 pid: 5854 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.551184:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956150 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d312a expref: 24 pid: 5854 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.551202:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:2.0:1788263311.551207:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.551214:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.552151:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.552209:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263311.552308:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+23:2362:x1875129735884544:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 1184us (4038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263311.552315:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00010000:00010000:1.0:1788263311.552967:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.552980:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263311.553011:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788263311.553255:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956165 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3131 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.553280:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3131 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.553290:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:1.0:1788263311.553293:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788263311.553296:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658c00, rc 0) 00000100:00100000:1.0:1788263311.553342:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+23:9985:x1875129735884416:12345-192.168.201.29@tcp:101:bash.0 Request processed in 17861us (18331us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788263311.553351:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:3.0:1788263311.565424:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263311.565539:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735884800 00000100:00100000:0.0:1788263311.565553:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735884800 00000100:00100000:0.0:1788263311.565631:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:0.0:1788263311.565643:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+23:9985:x1875129735884800:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:0.0:1788263311.566030:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.566052:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.566065:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788263311.566146:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788263311.566173:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3098e46 reply state 000000004eb7dc0f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263311.566182:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788263311.566274:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788263311.566390:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+27:9985:x1875129735884800:12345-192.168.201.29@tcp:36:bash.0 Request processed in 748us (981us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788263311.566399:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 89 00000020:00080000:0.0:1788263311.566405:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788263311.571567:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.571590:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.571599:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.571625:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263311.571632:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.571641:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.571664:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:1.0:1788263311.571668:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263311.571674:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.571681:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395617a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263311.572514:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263311.572985:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735884928 00000100:00100000:1.0:1788263311.573000:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735884928 00000100:00100000:1.0:1788263311.573070:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:1.0:1788263311.573081:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+26:9985:x1875129735884928:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263311.573113:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263311.573138:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3138 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.573233:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3138 expref: 27 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.573250:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3138 expref: 27 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.573293:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:1.0:1788263311.573297:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788263311.573301:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159c00, rc 0) 00000100:00100000:1.0:1788263311.573513:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+27:9985:x1875129735884928:12345-192.168.201.29@tcp:101:bash.0 Request processed in 432us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263311.573522:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:3.0:1788263311.583325:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263311.583449:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735885056 00000100:00100000:1.0:1788263311.583463:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735885056 00000100:00100000:1.0:1788263311.583560:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788263311.583575:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:9985:x1875129735885056:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263311.583600:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263311.583632:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d313f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263311.583669:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a96bb8b, atime: 0x6a96bb8a, ctime: 0x6a96bb8b, blocks: 0xb 00010000:00010000:1.0:1788263311.583699:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1788263311.583704:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263311.583714:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d313f expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.583734:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d313f expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.583751:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159600, rc 0) 00000100:00100000:1.0:1788263311.583845:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:9985:x1875129735885056:12345-192.168.201.29@tcp:101:bash.0 Request processed in 263us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263311.583870:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00080000:3.0:1788263311.584305:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263311.593862:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263311.594691:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735885184 00000100:00100000:0.0:1788263311.594707:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735885184 00002000:00010000:0.0:1788263311.594765:0:6708:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788263311.594770:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99437f6b6680 with x1875129735885184 ext(0->18446744073709551615) 00002000:00010000:0.0:1788263311.594785:0:6708:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99437f6b6680. 00000100:00100000:0.0:1788263311.594830:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1788263311.595069:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735885184:12345-192.168.201.29@tcp:10:bash.0 00002000:00010000:0.0:1788263311.595474:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788263311.595479:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788263307 -> 1788263311 00002000:00010000:0.0:1788263311.595482:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788263306 -> 1788263306 00002000:00010000:0.0:1788263311.595484:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788263307 -> 1788263311 00002000:00010000:0.0:1788263311.595487:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788263311.595669:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+8:2361:x1875129735885184:12345-192.168.201.29@tcp:10:bash.0 Request processed in 604us (1830us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788263311.595678:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00002000:00010000:0.0:1788263311.595683:0:6708:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788263311.595704:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99437f6b6680 with x1875129735885184 ext(0->18446744073709551615) 00002000:00010000:0.0:1788263311.595710:0:6708:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99437f6b6680. 00000100:00100000:3.0:1788263311.674782:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263311.674905:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735885312 00000100:00100000:3.0:1788263311.674917:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735885312 00000100:00100000:3.0:1788263311.675057:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:3.0:1788263311.675070:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+27:10480:x1875129735885312:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1788263311.675166:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675187:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675200:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675247:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675277:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675285:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675535:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675545:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675552:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263311.675597:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675610:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675617:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675624:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675630:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263311.675634:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675643:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675665:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:3.0:1788263311.675668:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263311.675674:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675680:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395618f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675695:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675700:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675706:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675712:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263311.675715:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675721:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675728:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994352cd3300) 00010000:00010000:3.0:1788263311.675730:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263311.675733:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675739:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675764:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675771:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675777:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675782:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263311.675785:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675790:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675797:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:3.0:1788263311.675799:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263311.675801:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263311.675807:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395619d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263311.676582:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+27:10480:x1875129735885312:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 1507us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263311.676593:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000001:00080000:0.0:1788263311.710270:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1788263311.710289:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788263311.717325:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263311.717472:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735885568 00000100:00100000:2.0:1788263311.717484:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735885568 00000100:00100000:2.0:1788263311.717546:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:2.0:1788263311.717555:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+27:10483:x1875129735885568:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263311.717585:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263311.717608:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139561a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3146 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.717682:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.717697:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.717708:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.717719:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.717723:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.717728:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718259:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139561b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718268:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139561b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718273:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139561b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263311.718282:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788263311.718378:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718384:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718389:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718393:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263311.718396:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718401:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718410:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263311.718412:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263311.718415:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718427:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139561ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718439:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718442:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718446:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718449:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263311.718451:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718454:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718458:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99434314f600) 00010000:00010000:2.0:1788263311.718460:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263311.718461:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718464:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139561b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718500:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139561a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3146 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718509:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139561b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3146 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.718519:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:2.0:1788263311.718520:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788263311.718522:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6200, rc 0) 00000100:00100000:2.0:1788263311.718591:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+29:10483:x1875129735885568:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1035us (1276us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788263311.718599:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:3.0:1788263311.722182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263311.722335:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735885696 00000100:00100000:0.0:1788263311.722346:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735885696 00000100:00100000:0.0:1788263311.722405:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:0.0:1788263311.722414:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+29:10483:x1875129735885696:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1788263311.722496:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.722512:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3131 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.722520:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.722555:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3131 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.722566:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3131 expref: 29 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263311.722581:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381291180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753729024:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263311.722693:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff994350ded3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263311.726266:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381291180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753729024:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263311.726310:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263311.726614:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263311.726669:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735885952 00000100:00100000:0.0:1788263311.726678:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735885952 00000100:00100000:0.0:1788263311.726786:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1788263311.726799:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+30:6059:x1875129735885952:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788263311.727284:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+31:6059:x1875129735885952:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 485us (670us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788263311.727293:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1788263311.729199:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263311.729384:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735886080 00000100:00100000:2.0:1788263311.729394:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735886080 00010000:00010000:2.0:1788263311.729440:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3131 expref: 31 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263311.729524:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:2.0:1788263311.729536:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+31:2362:x1875129735886080:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263311.729554:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263311.729562:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3131 expref: 31 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.729577:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3131 expref: 31 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.729605:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc51395616c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3131 expref: 31 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.729624:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:2.0:1788263311.729630:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.729653:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.729661:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.729696:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263311.729759:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+30:2362:x1875129735886080:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 225us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263311.729766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00010000:00010000:0.0:1788263311.730573:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.730587:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.730629:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.730636:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.730643:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.730650:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263311.730655:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.730663:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.730695:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:0.0:1788263311.730698:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263311.730702:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.730708:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263311.730787:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+29:10483:x1875129735885696:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 8370us (8612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263311.730797:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:3.0:1788263311.733441:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263311.733564:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735886336 00000100:00100000:1.0:1788263311.733576:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735886336 00000100:00100000:1.0:1788263311.733644:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1788263311.733655:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+29:10483:x1875129735886336:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788263311.734022:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+30:10483:x1875129735886336:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 367us (594us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788263311.734030:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:3.0:1788263311.812081:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263311.812282:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735886592 00000100:00100000:1.0:1788263311.812296:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735886592 00000100:00100000:1.0:1788263311.812373:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:1.0:1788263311.812386:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+30:10494:x1875129735886592:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:1.0:1788263311.812420:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263311.812447:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139561ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d314d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.812547:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.812565:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.812579:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.812599:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.812629:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.812637:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813018:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139561e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813028:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139561e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813034:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139561e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263311.813045:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788263311.813160:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813168:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813175:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813181:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263311.813185:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813192:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813271:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:1.0:1788263311.813275:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263311.813280:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813287:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139561d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813303:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813309:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813314:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813319:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263311.813323:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813329:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813338:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9943565b5300) 00010000:00010000:1.0:1788263311.813351:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263311.813354:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813360:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139561dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813428:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139561ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d314d expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813444:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139561e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d314d expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.813452:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:1.0:1788263311.813454:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263311.813457:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158800, rc 0) 00000100:00100000:1.0:1788263311.813958:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+32:10494:x1875129735886592:12345-192.168.201.29@tcp:101:cat.0 Request processed in 1570us (1891us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788263311.813967:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:3.0:1788263311.825048:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263311.825366:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735886848 00000100:00100000:0.0:1788263311.825378:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735886848 00000100:00100000:0.0:1788263311.825578:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:0.0:1788263311.825592:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+32:10494:x1875129735886848:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:0.0:1788263311.825919:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+33:10494:x1875129735886848:12345-192.168.201.29@tcp:35:cat.0 Request processed in 329us (886us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788263311.825937:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:3.0:1788263311.851088:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263311.851204:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735887104 00000100:00100000:0.0:1788263311.851274:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735887104 00000100:00100000:0.0:1788263311.851351:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:0.0:1788263311.851363:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+33:10495:x1875129735887104:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:0.0:1788263311.851455:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788263311.851491:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139561e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d314d expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851518:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139561b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3146 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851555:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3138 expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851568:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994352cd3800) 00010000:00010000:0.0:1788263311.851580:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263311.851609:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851624:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851635:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851652:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851659:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851667:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851982:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851991:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.851999:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263311.852690:0:6725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788263311.852703:0:6725:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338640484586ns, next at 339640481000ns, rc = 0 00010000:00010000:0.0:1788263311.852778:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852788:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852798:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852805:0:6725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852813:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852820:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852843:0:6725:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263311.852869:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852875:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852882:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852888:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263311.852901:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852909:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852921:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263311.852924:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788263311.852940:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852947:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139561ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852967:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852973:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852979:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852984:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263311.852986:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852992:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.852999:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:0.0:1788263311.853001:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263311.853011:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.853017:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc5139561f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263311.853027:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8809fb2 reply state 0000000010a53971 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263311.853038:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263311.853158:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+32:10495:x1875129735887104:12345-192.168.201.29@tcp:36:rm.0 Request processed in 1792us (2080us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788263311.853168:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00010000:00010000:1.0:1788263311.853554:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263311.853562:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.853569:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263311.853573:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.853579:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.853589:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff994344cab100) 00010000:00010000:1.0:1788263311.853592:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263311.853596:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.853602:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956206 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.853628:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263311.853630:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263311.853632:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263311.857818:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.857854:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.857863:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.857871:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263311.857876:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.857885:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.857906:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994344cabe00) 00010000:00010000:0.0:1788263311.857909:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263311.857915:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.857948:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139561f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263311.916902:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263311.917326:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735887360 00000100:00100000:1.0:1788263311.917342:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735887360 00000100:00100000:1.0:1788263311.917426:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:1.0:1788263311.917451:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+31:10501:x1875129735887360:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263311.917486:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263311.917515:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395620d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3154 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.917678:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.917698:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.917712:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.917732:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.917740:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.917748:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263311.920818:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788263311.921512:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921536:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921551:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921600:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921607:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921614:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921620:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263311.921625:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921633:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921647:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:0.0:1788263311.921651:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263311.921674:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921681:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956214 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263311.921699:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c67d0af2 reply state 00000000c7a6d7d1 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263311.921710:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788263311.921755:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395620d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3154 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921773:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3154 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.921782:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994344cabe00) 00010000:00010000:0.0:1788263311.921785:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263311.921787:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658e00, rc 0) 00000100:00100000:0.0:1788263311.922327:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+34:10501:x1875129735887360:12345-192.168.201.29@tcp:101:bash.0 Request processed in 4887us (5444us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788263311.922339:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:3.0:1788263311.928687:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263311.928975:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735887488 00000100:00100000:2.0:1788263311.928989:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735887488 00000100:00100000:2.0:1788263311.929078:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:2.0:1788263311.929092:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735887488:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263311.929116:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263311.929146:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d315b expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263311.929182:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263311.929205:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1788263311.929209:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263311.929249:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d315b expref: 6 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.929272:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d315b expref: 6 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263311.929317:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6a00, rc 0) 00000100:00100000:2.0:1788263311.929389:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735887488:12345-192.168.201.29@tcp:101:bash.0 Request processed in 301us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263311.929397:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00080000:3.0:1788263311.929765:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788263311.932891:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.932947:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.932956:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.932963:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263311.932969:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.932977:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.933000:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9943565b5300) 00010000:00010000:1.0:1788263311.933004:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263311.933009:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.933016:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395621b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263311.934502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263311.934668:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735887616 00000100:00100000:1.0:1788263311.934680:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735887616 00000100:00100000:1.0:1788263311.934738:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:1.0:1788263311.934749:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:10501:x1875129735887616:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263311.934771:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263311.934796:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3162 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.934862:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d315b expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.934873:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263311.934878:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263311.934884:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.934924:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d315b expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.934948:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d315b expref: 7 pid: 8112 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263311.934965:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1875129753729152:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263311.935074:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263311.938614:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263311.938787:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735887744 00000100:00100000:0.0:1788263311.938799:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735887744 00010000:00010000:0.0:1788263311.938865:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d315b expref: 8 pid: 8112 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263311.938920:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:0.0:1788263311.938947:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+8:2361:x1875129735887744:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263311.939003:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263311.939034:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d315b expref: 8 pid: 8112 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.939051:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d315b expref: 8 pid: 8112 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.939081:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263311.939087:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263311.939098:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.939109:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263311.939158:0:8470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263311.939176:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381291180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8470:1875129753729280:192.168.201.29@tcp:105: 00000100:00100000:0.0:1788263311.939318:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff994350ded9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788263311.939829:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be17916/0x1a657bc513956230 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d315b expref: 8 pid: 8112 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263311.939847:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1875129753729152:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263311.939878:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263311.939890:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158000, rc 0) 00000100:00100000:1.0:1788263311.939951:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:10501:x1875129735887616:12345-192.168.201.29@tcp:101:bash.0 Request processed in 5202us (5460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263311.939960:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1788263311.944428:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263311.944610:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735888000 00000100:00100000:1.0:1788263311.944623:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735888000 00000100:00100000:1.0:1788263311.944704:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1788263311.944718:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+33:10501:x1875129735888000:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:1.0:1788263311.945246:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+34:10501:x1875129735888000:12345-192.168.201.29@tcp:35:bash.0 Request processed in 498us (995us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788263311.945256:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788263311.946197:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381291180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8470:1875129753729280:192.168.201.29@tcp:105: 00010000:00010000:0.0:1788263311.946266:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263311.946325:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc92c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735887744:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 7380us (7725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263311.946335:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1788263312.123582:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753729792:0@lo:400:kworker.0 00000100:00100000:1.0:1788263312.123698:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263312.123794:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263312.123800:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753729664:0@lo:400:kworker.0 00000100:00100000:1.0:1788263312.123838:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263312.123877:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753729792 00000100:00100000:1.0:1788263312.123887:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753729792 00000100:00100000:1.0:1788263312.123969:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788263312.123980:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3323:x1875129753729792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263312.124054:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3323:x1875129753729792:12345-0@lo:400:kworker.0 Request processed in 76us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.124063:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788263312.124116:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753729792:0@lo:400:kworker.0 00000100:00080000:3.0:1788263312.124418:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263312.124596:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753729408:0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.124645:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263312.124685:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753729920:0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.124711:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263312.124742:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788263312.124748:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753729536:0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.124770:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263312.124791:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753730048:0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.124814:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263312.124854:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753730048 00000100:00100000:0.0:1788263312.124859:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753730048 00000100:00100000:0.0:1788263312.124902:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263312.124911:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753730048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.124965:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753730048:12345-0@lo:400:kworker.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.124972:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788263312.125005:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788263312.125024:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788263312.125030:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788263312.125051:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994379f26d80, transno 4294967301 00000100:00100000:0.0:1788263312.125064:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753730048:0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.125371:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753729664 00000100:00100000:0.0:1788263312.125376:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753729664 00000100:00100000:0.0:1788263312.125413:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753729920 00000100:00100000:0.0:1788263312.125416:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753729920 00000100:00100000:0.0:1788263312.125429:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753729536 00000100:00100000:0.0:1788263312.125431:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753729536 00000100:00100000:1.0:1788263312.125912:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788263312.125937:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753729664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.126059:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788263312.126066:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753729920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.126127:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875129753729920:12345-0@lo:400:kworker.0 Request processed in 62us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.126133:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788263312.126148:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788263312.126154:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753729536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.126181:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753729536:12345-0@lo:400:kworker.0 Request processed in 26us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.126186:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788263312.126203:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263312.126258:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753729536:0@lo:400:kworker.0 00000100:00100000:0.0:1788263312.126270:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753729920:0@lo:400:kworker.0 00000100:00100000:3.0:1788263312.126388:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753729408 00000100:00100000:3.0:1788263312.126394:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753729408 00000100:00100000:3.0:1788263312.126444:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788263312.126453:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753729408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263312.126497:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3320:x1875129753729408:12345-0@lo:400:kworker.0 Request processed in 46us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263312.126504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788263312.126548:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753729408:0@lo:400:kworker.0 00000100:00100000:1.0:1788263312.126766:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753729664:12345-0@lo:400:kworker.0 Request processed in 844us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.126775:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788263312.127126:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753729664:0@lo:400:kworker.0 00000100:00100000:3.0:1788263312.168371:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.168536:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735888128 00000100:00100000:0.0:1788263312.168547:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735888128 00000100:00100000:0.0:1788263312.168621:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:0.0:1788263312.168630:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+34:10517:x1875129735888128:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263312.168657:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263312.168682:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc51395623e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3169 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.168752:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.168764:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.168793:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263312.168833:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788263312.168837:0:6725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263312.168858:0:6725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.168888:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc51395623e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3169 expref: 36 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.168910:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3169 expref: 35 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.168920:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:0.0:1788263312.168934:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263312.168939:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659800, rc 0) 00000100:00100000:0.0:1788263312.169015:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+35:10517:x1875129735888128:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 384us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.169023:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:3.0:1788263312.173909:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.176276:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735888384 00000100:00100000:0.0:1788263312.176296:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735888384 00000100:00100000:0.0:1788263312.176387:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:0.0:1788263312.176399:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+35:10517:x1875129735888384:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263312.176425:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263312.176454:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc51395624c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3170 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.176635:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956253 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.176652:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.176666:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263312.176680:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788263312.179205:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc51395624c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3170 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.180565:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3170 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.180578:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994344cabe00) 00010000:00010000:0.0:1788263312.180582:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263312.180587:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658600, rc 0) 00000100:00100000:0.0:1788263312.180730:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+37:10517:x1875129735888384:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 4331us (6835us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788263312.180741:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:3.0:1788263312.193604:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.194077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735888512 00000100:00100000:2.0:1788263312.194092:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735888512 00000100:00100000:2.0:1788263312.194180:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788263312.194195:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+37:2360:x1875129735888512:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263312.194270:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263312.194308:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3170 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.194341:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994344cabe00) 00010000:00010000:2.0:1788263312.194347:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263312.194425:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+36:2360:x1875129735888512:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 234us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.194444:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788263312.195051:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.195363:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735888768 00000100:00100000:1.0:1788263312.195372:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735888768 00000100:00100000:1.0:1788263312.195427:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:1.0:1788263312.195602:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+36:10517:x1875129735888768:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263312.195633:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263312.195654:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956261 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3177 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.195859:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.195875:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.195887:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263312.195901:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788263312.196068:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956261 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3177 expref: 39 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.196089:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3177 expref: 38 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.196098:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994344cabe00) 00010000:00010000:1.0:1788263312.196100:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788263312.196121:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158400, rc 0) 00000100:00100000:1.0:1788263312.196185:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+38:10517:x1875129735888768:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 589us (1138us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788263312.196192:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:0.0:1788263312.206554:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.207529:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735888896 00000100:00100000:1.0:1788263312.207545:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735888896 00000100:00100000:1.0:1788263312.209049:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:1.0:1788263312.209077:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735888896:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:1.0:1788263312.209148:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.209175:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.209184:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263312.209189:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263312.209194:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.209263:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.209283:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 6 pid: 6702 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.209300:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8112:1875129753730176:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263312.209449:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788263312.215652:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.216791:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735889024 00000100:00100000:0.0:1788263312.216805:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735889024 00002000:00100000:0.0:1788263312.216881:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff994380632d80 x1875129735889024/t0(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:523/0 lens 504/0 e 0 to 0 dl 1788263323 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263312.216919:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994380632d80 with x1875129735889024 ext(0->8) 00010000:00010000:0.0:1788263312.216941:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 7 pid: 6702 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.216963:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 7 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263312.216972:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994380632d80 00000100:00100000:0.0:1788263312.217024:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1788263312.217036:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735889024:12345-192.168.201.29@tcp:4:lfs.0 00000100:00100000:0.0:1788263312.217705:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fedef325-db54-4469-b29a-301ff58466df+9:2361:x1875129735889024:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 667us (2065us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788263312.217715:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00002000:00100000:0.0:1788263312.217724:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff994380632d80 x1875129735889024/t4294967302(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:523/0 lens 504/448 e 0 to 0 dl 1788263323 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263312.217732:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994380632d80 with x1875129735889024 ext(0->8) 00010000:00010000:0.0:1788263312.217738:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 9 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.217751:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 9 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263312.217758:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994380632d80 00000100:00100000:1.0:1788263312.218506:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8112:1875129753730176:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263312.218543:0:8112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.221401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.221548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735889152 00000100:00100000:2.0:1788263312.221561:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735889152 00010000:00010000:2.0:1788263312.221613:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 9 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263312.221669:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1788263312.221682:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+9:2361:x1875129735889152:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263312.221723:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788263312.221748:0:5837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788263312.221751:0:5837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788263311 00002000:00010000:2.0:1788263312.221754:0:5837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788263312 00002000:00010000:2.0:1788263312.221756:0:5837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788263311 00010000:00010000:2.0:1788263312.221763:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 9 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.221780:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 9 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.221813:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c97c7b05/0x1a657bc513956237 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3162 expref: 9 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.221843:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788263312.221848:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263312.221855:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.221868:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.221910:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263312.221996:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+8:2361:x1875129735889152:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 314us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.222004:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00010000:00010000:3.0:1788263312.222489:0:8112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.222567:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.222601:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.222609:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.222617:0:8112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.222624:0:8112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263312.222629:0:8112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.222637:0:8112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.222651:0:8112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.222658:0:8112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d70b71b/0x1a657bc513956276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.222742:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735888896:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 13676us (16201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263312.222753:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1788263312.226508:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.229023:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735889408 00000100:00100000:1.0:1788263312.229047:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735889408 00000100:00100000:1.0:1788263312.229134:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1788263312.229147:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+38:10517:x1875129735889408:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:1.0:1788263312.229255:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3177 expref: 38 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263312.229548:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788263312.229574:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788263312.230808:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788263312.231196:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.232082:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3154 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.232101:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.232164:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3154 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.232184:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3154 expref: 42 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.232265:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875129753730304:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263312.232401:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263312.237194:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1875129753730304:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263312.237202:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:1.0:1788263312.237276:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.237357:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735889536 00000100:00100000:3.0:1788263312.237366:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735889536 00010000:00010000:3.0:1788263312.237414:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3154 expref: 43 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.237452:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:3.0:1788263312.237463:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+43:2361:x1875129735889536:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263312.237537:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263312.237546:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3154 expref: 43 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.237560:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3154 expref: 43 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.237588:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3154 expref: 43 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.237607:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994344cabe00) 00010000:00010000:3.0:1788263312.237613:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.237623:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.237639:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.237669:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263312.237741:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+42:2361:x1875129735889536:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 279us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263312.237749:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00010000:00010000:1.0:1788263312.238067:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.238075:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263312.238399:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788263312.238664:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788263312.238833:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875129753730432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788263312.238902:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263312.238945:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263312.239154:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753730432 00000100:00100000:2.0:1788263312.239163:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753730432 00000100:00100000:2.0:1788263312.239240:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263312.239251:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875129753730432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788263312.239357:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875129753730432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 107us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.239365:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263312.240277:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875129753730432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788263312.240716:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788263312.240797:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381291500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875129753730560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788263312.240857:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263312.240894:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff994350deda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263312.240917:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753730560 00000100:00100000:2.0:1788263312.240936:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753730560 00000100:00100000:2.0:1788263312.241024:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263312.241035:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1875129753730560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788263312.241266:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1875129753730560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 232us (408us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788263312.241275:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263312.241357:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381291500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1875129753730560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788263312.241414:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788263312.241455:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.241467:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.241476:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.241482:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263312.241487:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.241495:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.241514:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994344cabe00) 00010000:00010000:0.0:1788263312.241519:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788263312.241524:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.241531:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395627d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263312.241733:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788263312.241856:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788263312.241871:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339029652165ns, next at 340029648575ns, rc = 0 00000001:00080000:0.0:1788263312.241877:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788263312.241909:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff994344cabe00) 00010000:00010000:0.0:1788263312.241912:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788263312.241931:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3177 expref: 46 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263312.242055:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+45:10517:x1875129735889408:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 12910us (15564us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788263312.242064:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000020:00080000:0.0:1788263312.242069:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788263312.248188:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.248318:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735889664 00000100:00100000:1.0:1788263312.248331:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735889664 00000100:00100000:1.0:1788263312.248408:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:1.0:1788263312.248422:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+45:10517:x1875129735889664:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263312.248455:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263312.248487:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d317e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.248571:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d317e expref: 46 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.248608:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d317e expref: 46 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.248634:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:1.0:1788263312.248637:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788263312.248643:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159c00, rc 0) 00000100:00100000:1.0:1788263312.248723:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+46:10517:x1875129735889664:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 304us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.248731:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:3.0:1788263312.255116:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.255352:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735889920 00000100:00100000:2.0:1788263312.255365:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735889920 00000100:00100000:2.0:1788263312.255434:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:2.0:1788263312.255446:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+46:10517:x1875129735889920:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263312.255991:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+47:10517:x1875129735889920:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 542us (885us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788263312.256001:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:3.0:1788263312.338529:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.338649:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735890048 00000100:00100000:0.0:1788263312.338663:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735890048 00000100:00100000:0.0:1788263312.338741:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:0.0:1788263312.338753:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+47:10527:x1875129735890048:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:0.0:1788263312.338887:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.338908:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.338932:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.338952:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.338978:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.338984:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339103:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339112:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339119:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263312.339175:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339191:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339197:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339203:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339210:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263312.339271:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339282:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339306:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:0.0:1788263312.339309:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263312.339315:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339321:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395628b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339337:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339342:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339347:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339353:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263312.339355:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339361:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339367:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff994344cabe00) 00010000:00010000:0.0:1788263312.339370:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263312.339372:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339377:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339403:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339410:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339415:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339420:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263312.339423:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339429:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339436:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263312.339438:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263312.339441:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.339446:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956299 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263312.339548:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+47:10527:x1875129735890048:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 793us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.339557:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:3.0:1788263312.399734:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.399961:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735890304 00000100:00100000:1.0:1788263312.399982:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735890304 00000100:00100000:1.0:1788263312.400064:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:1.0:1788263312.400076:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+47:10530:x1875129735890304:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263312.400104:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263312.400133:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139562a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3185 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400279:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400298:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400312:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400329:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400357:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400364:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400519:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400528:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400535:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263312.400545:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788263312.400668:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400676:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400683:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400690:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263312.400696:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400705:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400732:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:1.0:1788263312.400736:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263312.400742:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400748:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139562a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400763:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400769:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400775:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400780:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263312.400783:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400790:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400797:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9943565b5200) 00010000:00010000:1.0:1788263312.400799:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263312.400802:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400808:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400871:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139562a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3185 expref: 50 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400886:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3185 expref: 49 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.400893:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:1.0:1788263312.400895:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263312.400898:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158000, rc 0) 00000100:00100000:1.0:1788263312.400995:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+49:10530:x1875129735890304:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 920us (1275us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788263312.401003:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:3.0:1788263312.405530:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.406496:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735890432 00000100:00100000:0.0:1788263312.406514:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735890432 00000100:00100000:0.0:1788263312.406640:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:0.0:1788263312.406673:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+49:10530:x1875129735890432:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1788263312.406775:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.406796:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.406810:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.406858:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.406867:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.406874:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.406881:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263312.406886:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.406895:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.406910:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263312.406913:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263312.406933:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.406940:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139562c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263312.407255:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+49:10530:x1875129735890432:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 583us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.407265:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:3.0:1788263312.409951:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.410591:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735890688 00000100:00100000:1.0:1788263312.410605:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735890688 00000100:00100000:1.0:1788263312.410666:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1788263312.410677:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+49:10530:x1875129735890688:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788263312.411169:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+50:10530:x1875129735890688:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 491us (1254us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788263312.411179:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:0.0:1788263312.470723:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.470941:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735890944 00000100:00100000:2.0:1788263312.470954:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735890944 00000100:00100000:2.0:1788263312.472046:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:2.0:1788263312.472063:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+50:10540:x1875129735890944:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263312.472098:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263312.472119:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788263312.472157:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3169 expref: 50 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.472181:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263312.472187:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263312.472204:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139562ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d318c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.472373:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.472389:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3185 expref: 50 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.472397:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.472438:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3185 expref: 50 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.472452:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3185 expref: 50 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263312.472467:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753730688:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263312.472704:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263312.475694:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753730688:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263312.475731:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.477933:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.480578:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735891072 00000100:00100000:1.0:1788263312.480598:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735891072 00010000:00010000:1.0:1788263312.480668:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3185 expref: 51 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.480844:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1788263312.480858:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+51:2361:x1875129735891072:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263312.480898:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263312.480907:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3185 expref: 51 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.480933:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3185 expref: 51 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.480963:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139562b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3185 expref: 51 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.480995:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:1.0:1788263312.481002:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.481013:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.481021:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.481061:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263312.481146:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+50:2361:x1875129735891072:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 289us (3235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.481154:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00010000:00010000:0.0:1788263312.481567:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.481579:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263312.481605:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788263312.481805:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139562ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d318c expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.481826:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d318c expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.481835:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263312.481838:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788263312.481841:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7800, rc 0) 00000100:00100000:0.0:1788263312.481895:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+50:10540:x1875129735890944:12345-192.168.201.29@tcp:101:bash.0 Request processed in 9837us (11186us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788263312.481902:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:0.0:1788263312.485624:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263312.485730:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735891328 00000100:00100000:3.0:1788263312.485743:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735891328 00000100:00100000:3.0:1788263312.485832:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 105 00000100:00100000:3.0:1788263312.485845:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+50:10540:x1875129735891328:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:3.0:1788263312.486255:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.486278:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.486293:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263312.486358:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788263312.486386:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000527fd199 reply state 00000000a6e9846f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.486414:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263312.486527:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+53:10540:x1875129735891328:12345-192.168.201.29@tcp:36:bash.0 Request processed in 683us (917us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788263312.486535:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 105 00000020:00080000:3.0:1788263312.486542:0:6725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788263312.489853:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.489876:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.489904:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.489911:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263312.489926:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.489935:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.489958:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263312.489962:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263312.489967:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.489985:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139562df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263312.490645:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.490715:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735891456 00000100:00100000:1.0:1788263312.490728:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735891456 00000100:00100000:1.0:1788263312.490796:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:1.0:1788263312.490809:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+52:10540:x1875129735891456:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263312.490862:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263312.490884:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139562e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3193 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.491014:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.491031:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d318c expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.491041:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.491084:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d318c expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.491099:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d318c expref: 53 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.491115:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753730816:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263312.491250:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263312.493448:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753730816:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263312.493488:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263312.494408:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.494464:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735891584 00000100:00100000:1.0:1788263312.494474:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735891584 00010000:00010000:1.0:1788263312.494523:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d318c expref: 54 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.494581:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:1.0:1788263312.494593:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+54:2362:x1875129735891584:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263312.494613:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263312.494621:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d318c expref: 54 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.494634:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d318c expref: 54 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.494663:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139562d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d318c expref: 54 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.494683:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:1.0:1788263312.494689:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.494699:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.494708:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.494757:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263312.494841:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+53:2362:x1875129735891584:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 249us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.494850:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00010000:00010000:2.0:1788263312.494859:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.494867:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263312.494940:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788263312.494946:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263312.494980:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.495019:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139562e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3193 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.495036:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3193 expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.495043:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263312.495046:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263312.495049:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158600, rc 0) 00000100:00100000:2.0:1788263312.495078:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+52:10540:x1875129735891456:12345-192.168.201.29@tcp:101:bash.0 Request processed in 4272us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.495085:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:3.0:1788263312.498211:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.498342:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735891840 00000100:00100000:2.0:1788263312.498355:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735891840 00000100:00100000:2.0:1788263312.498421:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788263312.498432:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+52:10540:x1875129735891840:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:2.0:1788263312.498751:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+53:10540:x1875129735891840:12345-192.168.201.29@tcp:35:bash.0 Request processed in 319us (554us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788263312.498777:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:0.0:1788263312.556255:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263312.556339:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735891968 00000100:00100000:3.0:1788263312.556351:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735891968 00000100:00100000:3.0:1788263312.556413:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:3.0:1788263312.556421:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+53:10546:x1875129735891968:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263312.556449:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263312.556471:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139562f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d319a expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.556540:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139562fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.556554:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139562fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.556565:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139562fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263312.556602:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788263312.556606:0:6725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263312.556626:0:6725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139562fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.556655:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139562f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d319a expref: 55 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.556695:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139562fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d319a expref: 54 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.556704:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:3.0:1788263312.556707:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263312.556711:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ce00, rc 0) 00000100:00100000:3.0:1788263312.556777:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+54:10546:x1875129735891968:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 356us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263312.556786:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:0.0:1788263312.559529:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.559617:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735892096 00000100:00100000:2.0:1788263312.559628:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735892096 00000100:00100000:2.0:1788263312.559688:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:2.0:1788263312.559699:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+54:10546:x1875129735892096:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263312.559727:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263312.559754:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956302 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31a1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.559848:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.559866:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.559877:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.559890:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.559894:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.559899:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560013:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560042:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560050:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263312.560093:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788263312.560097:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263312.560113:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560124:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560130:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560135:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560140:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560144:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263312.560147:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560153:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560164:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263312.560166:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263312.560174:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560179:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956309 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560190:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560194:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560198:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560201:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263312.560202:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560205:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560209:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99434314f800) 00010000:00010000:2.0:1788263312.560210:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263312.560212:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560215:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560276:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956302 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a1 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560295:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a1 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.560301:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263312.560303:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263312.560305:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7600, rc 0) 00000100:00100000:2.0:1788263312.560368:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+55:10546:x1875129735892096:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 671us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.560373:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:1.0:1788263312.563200:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.563336:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735892224 00000100:00100000:2.0:1788263312.563348:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735892224 00000100:00100000:2.0:1788263312.563408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788263312.563416:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+55:2361:x1875129735892224:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263312.563431:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263312.563457:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956317 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a1 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.563475:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263312.563479:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263312.563537:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+54:2361:x1875129735892224:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 122us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.563542:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1788263312.564448:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263312.564516:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735892480 00000100:00100000:3.0:1788263312.564523:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735892480 00000100:00100000:3.0:1788263312.564565:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:3.0:1788263312.564573:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+54:10546:x1875129735892480:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263312.564595:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263312.564614:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395631e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31a8 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.564746:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.564768:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3193 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.564782:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.564838:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3193 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.564861:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3193 expref: 55 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.564878:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753730944:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263312.564993:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbcecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263312.567913:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.568148:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753730944:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263312.568186:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.568352:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735892608 00000100:00100000:3.0:1788263312.568362:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735892608 00010000:00010000:3.0:1788263312.568401:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3193 expref: 56 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.568434:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:3.0:1788263312.568445:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+56:2362:x1875129735892608:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263312.568464:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263312.568472:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3193 expref: 56 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.568487:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3193 expref: 56 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.568511:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139562ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3193 expref: 56 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.568526:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:3.0:1788263312.568530:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.568558:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.568564:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.568587:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263312.568610:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.568617:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263312.568642:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:3.0:1788263312.568650:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc93450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+55:2362:x1875129735892608:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 207us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263312.568658:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00010000:00010000:1.0:1788263312.568850:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395631e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a8 expref: 56 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.568869:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a8 expref: 55 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.568877:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:1.0:1788263312.568879:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788263312.568883:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d000, rc 0) 00000100:00100000:1.0:1788263312.568913:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+55:10546:x1875129735892480:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 4341us (4469us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788263312.568931:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:3.0:1788263312.570693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.570764:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735892864 00000100:00100000:0.0:1788263312.570774:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735892864 00000100:00100000:0.0:1788263312.570889:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1788263312.570901:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+55:10546:x1875129735892864:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:0.0:1788263312.570933:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263312.570982:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d317e expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.571003:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263312.571009:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263312.571163:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+54:10546:x1875129735892864:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 264us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.571169:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:2.0:1788263312.571306:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263312.572906:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.573006:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735892992 00000100:00100000:2.0:1788263312.573017:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735892992 00000100:00100000:2.0:1788263312.573092:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:2.0:1788263312.573104:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+54:10546:x1875129735892992:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:2.0:1788263312.573305:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.573325:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.573338:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263312.573538:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788263312.573627:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+54:10546:x1875129735892992:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 523us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.573636:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:3.0:1788263312.575046:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.575142:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735893120 00000100:00100000:0.0:1788263312.575155:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735893120 00000100:00100000:0.0:1788263312.575311:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:0.0:1788263312.575325:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+54:10546:x1875129735893120:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263312.575348:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263312.575373:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395633a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.575446:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.575457:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395633a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31af expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.575478:0:5852:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.575492:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395633a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31af expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.575508:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263312.575527:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263312.575531:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395633a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31af expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.575539:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658400, rc 0) 00000100:00100000:0.0:1788263312.575601:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+55:10546:x1875129735893120:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 280us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.575608:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:3.0:1788263312.636273:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753731072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263312.636386:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263312.637466:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753731072 00000100:00100000:2.0:1788263312.637483:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753731072 00000100:00100000:2.0:1788263312.637567:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788263312.637580:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753731072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263312.637985:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263312.638098:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753731072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 520us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.638107:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788263312.638302:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753731072:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788263312.701070:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263312.701084:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263312.701152:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788263312.701160:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263312.701374:0:11704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753731200:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788263312.701518:0:11704:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263312.713335:0:11704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753731200:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788263312.717496:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.718356:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735893248 00000100:00100000:0.0:1788263312.718373:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735893248 00000100:00100000:0.0:1788263312.718450:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:0.0:1788263312.718462:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+55:10547:x1875129735893248:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788263312.718510:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788263312.722717:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+55:10547:x1875129735893248:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 4242us (5222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.722734:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:0.0:1788263312.732123:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.732263:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735893376 00000100:00100000:1.0:1788263312.732277:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735893376 00000100:00100000:1.0:1788263312.732391:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:1.0:1788263312.732404:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+55:10547:x1875129735893376:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788263312.732522:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.732544:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.732558:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.736944:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.736969:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.736981:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737012:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737021:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737037:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263312.737088:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788263312.737092:0:6725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263312.737105:0:6725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737116:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737136:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737144:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737150:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263312.737154:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737161:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737173:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:1.0:1788263312.737175:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263312.737180:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737186:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956341 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737200:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737206:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737250:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737256:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263312.737264:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737270:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737278:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9943565b5200) 00010000:00010000:1.0:1788263312.737281:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263312.737284:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737289:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956348 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737306:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737311:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737317:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737322:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263312.737326:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737331:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737338:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:1.0:1788263312.737340:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263312.737349:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.737355:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc51395634f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.737470:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+55:10547:x1875129735893376:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 5064us (5359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.737482:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:3.0:1788263312.741809:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.743474:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735893632 00000100:00100000:2.0:1788263312.743490:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735893632 00000100:00100000:2.0:1788263312.743571:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:2.0:1788263312.743596:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+55:10547:x1875129735893632:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263312.743639:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263312.743662:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956356 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31b6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.743766:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.743781:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.743794:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263312.743805:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788263312.743908:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.743927:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.743934:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.743939:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263312.743943:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.743951:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.743963:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263312.743972:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788263312.743977:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.743983:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395635d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.744033:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956356 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31b6 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.744043:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:2.0:1788263312.744046:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263312.744049:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956356 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31b6 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.744060:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7800, rc 0) 00000100:00100000:2.0:1788263312.744138:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+56:10547:x1875129735893632:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 558us (2344us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788263312.744146:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:3.0:1788263312.749548:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.750094:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735893760 00000100:00100000:0.0:1788263312.750107:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735893760 00000100:00100000:0.0:1788263312.750302:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:0.0:1788263312.750315:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+56:10547:x1875129735893760:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788263312.750405:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788263312.750551:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+56:10547:x1875129735893760:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 238us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.750559:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:0.0:1788263312.766995:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.767182:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735894016 00000100:00100000:2.0:1788263312.767195:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735894016 00000100:00100000:2.0:1788263312.767297:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:2.0:1788263312.767310:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+56:10547:x1875129735894016:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263312.767339:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263312.767343:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788263312.767385:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139562fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d319a expref: 56 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.767409:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263312.767421:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263312.767438:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395636b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31bd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788263312.768149:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788263312.768478:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.768496:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.768508:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.768581:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395636b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31bd expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.768603:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31bd expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.768611:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99434314f800) 00010000:00010000:2.0:1788263312.768614:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263312.768617:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6e00, rc 0) 00000100:00100000:2.0:1788263312.768706:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+57:10547:x1875129735894016:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1399us (1723us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788263312.768716:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:3.0:1788263312.774015:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.774126:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735894272 00000100:00100000:1.0:1788263312.774140:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735894272 00000100:00100000:1.0:1788263312.774259:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:1.0:1788263312.774273:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+57:10547:x1875129735894272:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788263312.774362:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263312.774400:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31bd expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.774423:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99434314f800) 00010000:00010000:1.0:1788263312.774435:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263312.774467:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.774484:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.774495:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778098:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778148:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778163:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778325:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778334:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778341:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778347:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263312.778352:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778359:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778372:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:1.0:1788263312.778375:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263312.778380:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778385:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956380 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778398:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778413:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778420:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778425:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263312.778428:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778434:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778443:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xbc3262a8 (ffff9943565b5200) 00010000:00010000:1.0:1788263312.778446:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263312.778449:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.778454:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956387 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbc3262a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.779025:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+56:10547:x1875129735894272:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 4748us (5019us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263312.779035:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1788263312.785641:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.792142:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735894400 00000100:00100000:2.0:1788263312.792163:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735894400 00000100:00100000:3.0:1788263312.792565:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:3.0:1788263312.792601:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+56:10547:x1875129735894400:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263312.792632:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263312.792663:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395638e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31c4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.792708:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.792724:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.792737:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.793300:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395638e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31c4 expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.793324:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31c4 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.793457:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:3.0:1788263312.793460:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263312.793465:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d200, rc 0) 00000100:00100000:3.0:1788263312.793550:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+57:10547:x1875129735894400:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 953us (7924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263312.793558:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:0.0:1788263312.807585:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.807966:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735894656 00000100:00100000:2.0:1788263312.807983:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735894656 00000100:00100000:1.0:1788263312.808171:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:1.0:1788263312.808188:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+57:10547:x1875129735894656:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788263312.808309:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.808616:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.808629:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788263312.808883:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1788263312.809341:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f32c3a08 reply state 00000000c11c58b1 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.809353:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263312.809471:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+59:10547:x1875129735894656:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1284us (1899us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788263312.809479:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:0.0:1788263312.813579:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:1.0:1788263312.813647:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.813664:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.813672:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.813678:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263312.813683:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.813689:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.813711:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:1.0:1788263312.813735:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788263312.813742:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.813750:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc51395639c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263312.813765:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735894784 00000100:00100000:2.0:1788263312.813779:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735894784 00000100:00100000:2.0:1788263312.813862:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:2.0:1788263312.813875:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+58:10547:x1875129735894784:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263312.813906:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263312.813939:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31cb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.814021:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31cb expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.814037:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31cb expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.814073:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:2.0:1788263312.814076:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263312.814080:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7800, rc 0) 00000100:00100000:2.0:1788263312.814153:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+59:10547:x1875129735894784:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 280us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.814160:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1788263312.818005:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.818522:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735894912 00000100:00100000:0.0:1788263312.818537:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735894912 00000100:00100000:0.0:1788263312.818625:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:0.0:1788263312.818639:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+8:2359:x1875129735894912:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788263312.821004:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+9:2359:x1875129735894912:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 2353us (2998us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788263312.821020:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:1.0:1788263312.830606:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.830684:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735895168 00000100:00100000:0.0:1788263312.830702:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735895168 00000100:00100000:0.0:1788263312.830783:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:0.0:1788263312.830795:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+59:10547:x1875129735895168:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788263312.831454:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+60:10547:x1875129735895168:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 656us (852us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788263312.831464:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:3.0:1788263312.835517:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.835856:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735895424 00000100:00100000:1.0:1788263312.835869:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735895424 00000100:00100000:1.0:1788263312.835992:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:1.0:1788263312.836004:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+60:10547:x1875129735895424:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788263312.836168:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+60:10547:x1875129735895424:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 165us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.836177:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:1.0:1788263312.842191:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263312.842759:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735895552 00000100:00100000:2.0:1788263312.842773:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735895552 00000100:00100000:2.0:1788263312.842864:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:2.0:1788263312.842877:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+60:10547:x1875129735895552:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263312.842906:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263312.842944:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139563aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.843209:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139563b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.843259:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139563b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.843273:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139563b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263312.843319:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263312.843343:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139563b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.843377:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139563aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d2 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.843398:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139563b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d2 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.843409:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:2.0:1788263312.843412:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788263312.843418:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6200, rc 0) 00000100:00100000:2.0:1788263312.843507:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+61:10547:x1875129735895552:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 631us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263312.843516:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:3.0:1788263312.846969:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.847708:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735895680 00000100:00100000:0.0:1788263312.847722:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735895680 00000100:00100000:1.0:1788263312.848025:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:1.0:1788263312.848041:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+9:2361:x1875129735895680:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263312.848070:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263312.848099:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31d9 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263312.848133:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bb90, blocks: 0x1 00010000:00010000:1.0:1788263312.848159:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1788263312.848164:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263312.848175:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d9 expref: 10 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.848214:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d9 expref: 10 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.848263:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159a00, rc 0) 00000100:00100000:1.0:1788263312.848343:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+10:2361:x1875129735895680:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 305us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.848351:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:3.0:1788263312.851885:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.851983:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735895936 00000100:00100000:0.0:1788263312.851998:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735895936 00000100:00100000:0.0:1788263312.852080:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:0.0:1788263312.852097:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+61:10547:x1875129735895936:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788263312.852772:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+61:10547:x1875129735895936:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 673us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.852783:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:2.0:1788263312.855254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.855355:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735896064 00000100:00100000:1.0:1788263312.855368:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735896064 00000100:00100000:1.0:1788263312.855437:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:1.0:1788263312.855449:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+10:10547:x1875129735896064:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263312.855471:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263312.855496:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.855536:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d9 expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.855545:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263312.855550:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263312.855557:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.855599:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d9 expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.855634:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d9 expref: 11 pid: 6705 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.855652:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1875129753731328:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263312.855822:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263312.859412:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.859503:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735896192 00000100:00100000:0.0:1788263312.859533:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735896192 00010000:00010000:0.0:1788263312.859587:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d9 expref: 12 pid: 6705 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263312.859646:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:0.0:1788263312.859658:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+12:2361:x1875129735896192:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263312.859680:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263312.859709:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d9 expref: 12 pid: 6705 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.859725:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d9 expref: 12 pid: 6705 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.859758:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263312.859764:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263312.859776:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.859787:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.860008:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263312.860158:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375ebe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5837:1875129753731456:192.168.201.29@tcp:105: 00000100:00100000:0.0:1788263312.860283:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788263312.860415:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d70b71b/0x1a657bc5139563b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d9 expref: 12 pid: 6705 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.860431:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1875129753731328:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263312.860459:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.860471:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158400, rc 0) 00000100:00100000:1.0:1788263312.860504:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+11:10547:x1875129735896064:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 5057us (5298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.860513:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1788263312.867070:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.867169:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735896320 00000100:00100000:1.0:1788263312.867181:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735896320 00002000:00100000:1.0:1788263312.867276:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99437f6b4380 x1875129735896320/t0(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:523/0 lens 504/0 e 0 to 0 dl 1788263323 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788263312.867288:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99437f6b4380 with x1875129735896320 ext(0->12) 00002000:00010000:1.0:1788263312.867294:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99437f6b4380 00000100:00100000:1.0:1788263312.867322:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1788263312.867349:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+11:2362:x1875129735896320:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788263312.867935:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+13:2362:x1875129735896320:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 583us (877us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788263312.867944:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00002000:00100000:1.0:1788263312.867953:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99437f6b4380 x1875129735896320/t4294967308(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:523/0 lens 504/448 e 0 to 0 dl 1788263323 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788263312.867962:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99437f6b4380 with x1875129735896320 ext(0->12) 00002000:00010000:1.0:1788263312.867966:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99437f6b4380 00000100:00100000:0.0:1788263312.868282:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375ebe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5837:1875129753731456:192.168.201.29@tcp:105: 00010000:00010000:0.0:1788263312.868313:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263312.868342:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+12:2361:x1875129735896192:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 8686us (8943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.868351:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1788263312.871506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263312.871606:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735896448 00000100:00100000:3.0:1788263312.871620:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735896448 00000100:00100000:3.0:1788263312.871696:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:3.0:1788263312.871710:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+61:10547:x1875129735896448:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788263312.925553:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788263312.925581:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788263312.925603:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994350dedf00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788263312.925609:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99437f769300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994350ded540 00000020:00080000:3.0:1788263312.925612:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99437f769400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99437617d800 00000004:00080000:3.0:1788263312.925639:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:3.0:1788263312.925977:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263312.926003:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753731584:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788263312.926247:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263312.926338:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753731712:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788263312.926367:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263312.926405:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753731584 00000100:00100000:3.0:1788263312.926413:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753731584 00000100:00100000:3.0:1788263312.926461:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753731712 00000100:00100000:3.0:1788263312.926464:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753731712 00000100:00100000:3.0:1788263312.926485:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788263312.926495:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753731584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788263312.926528:0:8112:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1788263312.926572:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a96bb8f, atime: 0x6a96bb90, ctime: 0x6a96bb8f, blocks: 0x1 00010000:00010000:3.0:1788263312.926590:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.926612:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1788263312.926617:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263312.926625:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.926643:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.926654:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.926664:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.926684:0:8112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788263312.927603:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3322:x1875129753731584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1103us (1383us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788263312.927616:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788263312.927648:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788263312.927658:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3320:x1875129753731712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788263312.927681:0:8112:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788263312.927705:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.927738:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d313f expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.927748:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788263312.927752:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263312.927756:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.927794:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d313f expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.927825:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d313f expref: 11 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.927842:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347297100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8112:1875129753731840:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263312.927928:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943722163c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788263312.927986:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99437f6b5c00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788263312.927994:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753731584:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1788263312.928136:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1788263312.928175:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263312.928185:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.928195:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263312.928200:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.928212:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.928264:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.928272:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc5139563c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.928312:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263312.928314:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263312.928316:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788263312.929203:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994346507480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788263312.929211:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994376201400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994346507c00 00000020:00080000:1.0:1788263312.929214:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994376201e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994347c0b000 00000020:00080000:1.0:1788263312.929271:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788263312.929489:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788263312.929619:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+15:10547:x1875129735896448:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 57907us (58122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.929643:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:3.0:1788263312.936562:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263312.936637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735896576 00000100:00100000:1.0:1788263312.936650:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735896576 00010000:00010000:1.0:1788263312.936702:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d313f expref: 12 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.936756:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1788263312.936768:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+12:2362:x1875129735896576:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263312.936788:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263312.936794:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d313f expref: 12 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.936819:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d313f expref: 12 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.936881:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263312.936886:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263312.936894:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.936906:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263312.936943:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263312.937017:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+12:2362:x1875129735896576:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 250us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.937026:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00010000:00010000:0.0:1788263312.937255:0:8112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc513956188 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d313f expref: 11 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263312.937274:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347297100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8112:1875129753731840:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263312.937305:0:8112:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.937316:0:8112:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.937323:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.937334:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.937343:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.937745:0:8112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788263312.938651:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3320:x1875129753731712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10990us (12277us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788263312.938671:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1788263312.938866:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99437f6b4700/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788263312.938892:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753731712:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788263312.941659:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.941760:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735896704 00000100:00100000:0.0:1788263312.941773:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735896704 00000100:00100000:0.0:1788263312.941854:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1788263312.941866:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+11:2362:x1875129735896704:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788263312.942733:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263312.942760:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.942775:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263312.942782:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.942795:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.942834:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.942843:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc5139563cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263312.942869:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263312.942871:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263312.942873:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263312.982678:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+11:2362:x1875129735896704:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 40798us (41016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263312.982718:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:3.0:1788263312.986428:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263312.986561:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735896960 00000100:00100000:0.0:1788263312.986573:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735896960 00000100:00100000:0.0:1788263312.986657:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:0.0:1788263312.986670:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+15:10547:x1875129735896960:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788263312.986746:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263312.986781:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139563b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31d2 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.986806:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:0.0:1788263312.986825:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263312.986865:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.986880:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.986891:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263312.987403:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3ea6e5f reply state 00000000172897e6 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263312.987416:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263312.987561:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+16:10547:x1875129735896960:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 891us (1145us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788263312.987570:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000001:00080000:0.0:1788263312.989410:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788263312.989435:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788263312.989454:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788263312.991873:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:0.0:1788263312.991964:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.991980:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.991989:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.991996:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263312.992002:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.992010:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.992032:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:0.0:1788263312.992034:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263312.992041:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263312.992047:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139563d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263312.993516:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735897088 00000100:00100000:1.0:1788263312.993536:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735897088 00000100:00100000:1.0:1788263312.993646:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:1.0:1788263312.993660:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735897088:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788263312.994112:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788263312.994117:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788263312 00002000:00010000:1.0:1788263312.994119:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788263312 00002000:00010000:1.0:1788263312.994121:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788263312 -> 1788263312 00002000:00010000:1.0:1788263312.994124:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788263312.994388:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:2359:x1875129735897088:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 729us (2528us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788263312.994397:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:2.0:1788263312.996967:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263312.997122:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735897344 00000100:00100000:3.0:1788263312.997135:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735897344 00000100:00100000:3.0:1788263312.997214:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:3.0:1788263312.997252:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+15:10547:x1875129735897344:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788263312.997344:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.997363:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31c4 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.997372:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.997414:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31c4 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263312.997429:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31c4 expref: 15 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263312.997445:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347296680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753731968:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263312.997555:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943722166c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263313.001833:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347296680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753731968:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263313.001873:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263313.002788:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263313.004576:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735897472 00000100:00100000:0.0:1788263313.004594:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735897472 00010000:00010000:0.0:1788263313.004731:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31c4 expref: 16 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263313.004781:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1788263313.004795:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+16:2362:x1875129735897472:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263313.004960:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263313.004980:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31c4 expref: 16 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.004998:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31c4 expref: 16 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.005028:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31c4 expref: 16 pid: 5854 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.005049:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:0.0:1788263313.005055:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.005065:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.005074:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.005157:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263313.005261:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+15:2362:x1875129735897472:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 469us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263313.005270:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00080000:2.0:1788263313.006378:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788263313.006784:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.006797:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.006936:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.006946:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.006954:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.006960:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263313.006965:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.007109:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.007130:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:3.0:1788263313.007133:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788263313.007138:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.007144:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263313.009392:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+14:10547:x1875129735897344:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 12127us (12421us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788263313.009426:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:3.0:1788263313.013279:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263313.013371:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735897600 00000100:00100000:1.0:1788263313.013404:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735897600 00000100:00100000:1.0:1788263313.013492:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1788263313.013504:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735897600:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788263313.013565:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.013593:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.013603:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263313.013609:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263313.013614:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.013663:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.013680:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 7 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263313.013698:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875129753732096:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263313.013806:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13fcc0 going to sleep for 11 seconds 00000100:00080000:2.0:1788263313.014017:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263313.018377:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263313.018621:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875129753732096:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263313.018663:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263313.019508:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735897728 00000100:00100000:0.0:1788263313.019521:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735897728 00010000:00010000:0.0:1788263313.019712:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 8 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263313.019759:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:0.0:1788263313.019773:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735897728:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263313.019889:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263313.019926:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 8 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.020077:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 8 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.020108:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139563bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e0 expref: 8 pid: 6702 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.020127:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263313.020136:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263313.020142:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.020152:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.020187:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263313.020359:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735897728:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 589us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263313.020385:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00010000:00010000:1.0:1788263313.020605:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.020616:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.020647:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.020655:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.020663:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.020670:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263313.020676:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.020684:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.020695:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.020716:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c97c7b05/0x1a657bc5139563e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263313.020776:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735897600:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 7274us (7514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263313.020785:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:0.0:1788263313.025358:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263313.025454:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735897984 00000100:00100000:1.0:1788263313.025467:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735897984 00000100:00100000:1.0:1788263313.025733:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:1.0:1788263313.025748:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+14:10547:x1875129735897984:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788263313.025872:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.025899:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.025926:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.026362:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.026377:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31cb expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.026387:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.026460:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31cb expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.026478:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31cb expref: 15 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263313.026496:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753732224:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263313.026613:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263313.030614:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753732224:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263313.030648:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263313.030740:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263313.030922:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735898112 00000100:00100000:3.0:1788263313.030931:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735898112 00010000:00010000:3.0:1788263313.030992:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31cb expref: 16 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263313.031127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:3.0:1788263313.031138:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+16:2361:x1875129735898112:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263313.031155:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263313.031161:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31cb expref: 16 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.031172:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31cb expref: 16 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.031201:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139563a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31cb expref: 16 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.031261:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:3.0:1788263313.031267:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.031279:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.031286:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.031322:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263313.031340:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.031348:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263313.031390:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+15:2361:x1875129735898112:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 253us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263313.031398:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000001:00080000:0.0:1788263313.031594:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788263313.031775:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788263313.031837:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788263313.031984:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375ebc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6725:1875129753732352:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788263313.032061:0:6725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263313.032154:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263313.032607:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753732352 00000100:00100000:0.0:1788263313.032617:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753732352 00000100:00100000:0.0:1788263313.032678:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263313.032687:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6725:x1875129753732352:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788263313.032832:0:6725:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788263313.032840:0:6725:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994381291880, transno 4294967303 00000004:00080000:2.0:1788263313.032861:0:6725:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788263313.032894:0:6725:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99437f6b4700, transno 4294967309 00000100:00100000:2.0:1788263313.032903:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375ebc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6725:1875129753732352:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788263313.033025:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6725:x1875129753732352:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263313.033033:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:2.0:1788263313.033476:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788263313.033558:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6725:1875129753732480:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788263313.033602:0:6725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263313.033635:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263313.034642:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753732480 00000100:00100000:1.0:1788263313.034655:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753732480 00000100:00100000:1.0:1788263313.034727:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263313.034738:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6725:x1875129753732480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788263313.035033:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6725:x1875129753732480:12345-0@lo:1000:mdt00_003.0 Request processed in 296us (1429us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788263313.035042:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263313.035274:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6725:1875129753732480:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788263313.035324:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035336:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035345:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035351:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263313.035356:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035364:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035384:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3300) 00010000:00010000:2.0:1788263313.035387:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263313.035393:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035399:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139563f0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035451:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035458:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035463:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035468:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263313.035471:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035476:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035485:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263313.035488:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263313.035496:0:6725:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395633a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31af expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035509:0:6725:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395633a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31af expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035520:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395633a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31af expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.035557:0:6725:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395633a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31af expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263313.035585:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753732608:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788263313.035674:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573000 going to sleep for 11 seconds 00000100:00100000:2.0:1788263313.039373:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263313.039405:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753732608:192.168.201.29@tcp:105: 00010000:00010000:0.0:1788263313.039440:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039453:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956333 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263313.039494:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735898240 00000100:00100000:1.0:1788263313.039502:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735898240 00010000:00010000:0.0:1788263313.039519:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039534:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039546:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039557:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039564:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039571:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039578:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263313.039582:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039589:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263313.039590:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1788263313.039601:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+19:10546:x1875129735898240:12345-192.168.201.29@tcp:49:lfs.0 00010000:00010000:0.0:1788263313.039602:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263313.039606:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263313.039609:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039614:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139563f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039630:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039635:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039640:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039644:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263313.039646:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039651:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039658:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263313.039660:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788263313.039663:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.039667:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139563e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263313.039765:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+19:10546:x1875129735898240:12345-192.168.201.29@tcp:49:lfs.0 Request processed in 165us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263313.039782:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000040:00080000:0.0:1788263313.040015:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263313.040021:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263313.040534:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788263313.040542:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788263313.040647:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+18:10547:x1875129735897984:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 14899us (15301us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788263313.040668:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 127 00000020:00080000:0.0:1788263313.040674:0:6725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788263313.043165:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263313.043316:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735898496 00000100:00100000:3.0:1788263313.043329:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735898496 00000100:00100000:3.0:1788263313.043400:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:3.0:1788263313.043413:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+18:10546:x1875129735898496:12345-192.168.201.29@tcp:58:lfs.0 00000040:00080000:3.0:1788263313.043931:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788263313.044101:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+18:10546:x1875129735898496:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 687us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263313.044113:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:3.0:1788263313.047100:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263313.052060:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735898752 00000100:00100000:2.0:1788263313.052083:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735898752 00000100:00100000:2.0:1788263313.052341:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:2.0:1788263313.052355:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+18:10547:x1875129735898752:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788263313.055447:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788263313.055853:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788263313.055954:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.055972:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.055996:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.056005:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.056011:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.056027:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.056055:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263313.056287:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263313.056299:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.056310:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263313.056315:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.056326:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263313.056337:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2c9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+20:10547:x1875129735898752:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 3979us (9245us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788263313.056366:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000020:00080000:3.0:1788263313.056375:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788263313.056377:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:1.0:1788263313.056384:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263313.056391:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.056399:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139563fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.056430:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263313.056432:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263313.056437:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263313.092129:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263313.092446:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735898880 00000100:00100000:2.0:1788263313.092459:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735898880 00000100:00100000:2.0:1788263313.092574:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:2.0:1788263313.092587:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+20:10549:x1875129735898880:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263313.092631:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263313.092661:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.092744:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.092762:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.092775:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.092793:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.092830:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.092836:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.093163:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.093321:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a8 expref: 21 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.093331:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.093377:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a8 expref: 21 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.093394:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a8 expref: 21 pid: 6725 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263313.093411:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753732736:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263313.093658:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263313.099047:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753732736:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263313.099090:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263313.099201:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263313.099254:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735899136 00000100:00100000:1.0:1788263313.099263:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735899136 00000100:00100000:1.0:1788263313.099375:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788263313.099404:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+22:6059:x1875129735899136:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788263313.099727:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+23:6059:x1875129735899136:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 323us (525us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788263313.099736:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1788263313.104078:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263313.105013:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735899264 00000100:00100000:0.0:1788263313.105030:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735899264 00010000:00010000:0.0:1788263313.105091:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a8 expref: 23 pid: 6725 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263313.105147:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:0.0:1788263313.105160:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+23:2362:x1875129735899264:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263313.105181:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263313.105189:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a8 expref: 23 pid: 6725 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.105205:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a8 expref: 23 pid: 6725 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.105275:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956325 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31a8 expref: 23 pid: 6725 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.105299:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263313.105306:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.105317:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.105348:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.105381:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263313.105459:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+22:2362:x1875129735899264:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 301us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263313.105468:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00010000:00010000:2.0:1788263313.105652:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105660:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263313.105725:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788263313.105730:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263313.105753:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105766:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105776:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105783:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105789:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105807:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263313.105817:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105825:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105837:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263313.105839:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263313.105843:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105849:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395640c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105873:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105879:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105884:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105890:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263313.105892:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105898:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105917:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99434314f500) 00010000:00010000:2.0:1788263313.105920:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263313.105923:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105930:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105975:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e7 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.105990:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e7 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.106009:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263313.106012:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263313.106014:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6e00, rc 0) 00000100:00100000:2.0:1788263313.106048:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+21:10549:x1875129735898880:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 13463us (13934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.106056:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 129 00000004:00080000:1.0:1788263313.148348:0:6800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339936125845ns, next at 340936122948ns, rc = 0 00000100:00100000:3.0:1788263313.148608:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753732864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263313.148700:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263313.149436:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753732864 00000100:00100000:2.0:1788263313.149449:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753732864 00000100:00100000:2.0:1788263313.149520:0:11722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788263313.149534:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753732864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263313.149567:0:11722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788263313.149641:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753732864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.149649:0:11722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788263313.150536:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753732864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263313.595613:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263313.976020:0:12128:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263313.976033:0:12128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263313.976083:0:12128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788263313.976089:0:12128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788263314.043920:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263314.043933:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263314.044063:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788263314.044072:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788263314.045280:0:11704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375ebdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753732992:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788263314.045431:0:11704:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263314.062290:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263314.062524:0:11704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375ebdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753732992:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788263314.062728:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735899392 00000100:00100000:0.0:1788263314.062737:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735899392 00000100:00100000:0.0:1788263314.062818:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:0.0:1788263314.062829:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+21:10561:x1875129735899392:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788263314.062871:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788263314.062998:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+21:10561:x1875129735899392:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 169us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263314.063006:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:2.0:1788263314.077744:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263314.078007:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735899648 00000100:00100000:0.0:1788263314.078022:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735899648 00000100:00100000:0.0:1788263314.078106:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:0.0:1788263314.078141:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+21:10561:x1875129735899648:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263314.078172:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263314.078198:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956421 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31ee expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.078477:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.078495:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.078510:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263314.078525:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788263314.078704:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956421 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31ee expref: 24 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.078726:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31ee expref: 23 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.078736:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263314.078739:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263314.078744:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659c00, rc 0) 00000100:00100000:0.0:1788263314.079109:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+23:10561:x1875129735899648:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 959us (1362us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788263314.079120:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:3.0:1788263314.086455:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263314.086693:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735899904 00000100:00100000:1.0:1788263314.086708:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735899904 00000100:00100000:1.0:1788263314.086780:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00100000:1.0:1788263314.086968:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+23:10561:x1875129735899904:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788263314.087096:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.087120:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.087136:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263314.091582:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263314.091675:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735900032 00000100:00100000:1.0:1788263314.091689:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735900032 00000100:00100000:1.0:1788263314.091779:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1788263314.091802:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347295180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+24:2362:x1875129735900032:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263314.091828:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263314.091874:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc513956428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31ee expref: 24 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.091913:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:1.0:1788263314.091920:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263314.091991:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347295180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+23:2362:x1875129735900032:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 201us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263314.091999:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00010000:00010000:2.0:1788263314.094174:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.094195:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.094204:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.094211:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263314.094445:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.094467:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.094490:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263314.094493:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788263314.094499:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.094507:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956436 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263314.094759:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+23:10561:x1875129735899904:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 7961us (8315us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788263314.094770:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 132 00000040:00080000:3.0:1788263314.095659:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263314.095667:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263314.096997:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788263314.097016:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263314.098300:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263314.098562:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735900288 00000100:00100000:2.0:1788263314.098576:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735900288 00000100:00100000:2.0:1788263314.098658:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:2.0:1788263314.098671:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+23:10561:x1875129735900288:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788263314.099102:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+24:10561:x1875129735900288:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 431us (820us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788263314.099112:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00010000:00010000:1.0:1788263314.619495:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263314.661852:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263314.662451:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263314.662487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263314.662515:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263314.662544:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263314.662593:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735900416 00000100:00100000:3.0:1788263314.662608:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735900416 00000100:00100000:3.0:1788263314.662673:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 282 00000100:00100000:3.0:1788263314.662685:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735900416:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263314.662795:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735900416:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 111us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263314.662805:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 282 00000100:00100000:0.0:1788263314.665274:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735900800 00000100:00100000:0.0:1788263314.665292:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735900800 00000100:00100000:0.0:1788263314.665400:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735900672 00000100:00100000:0.0:1788263314.665403:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735900672 00000100:00100000:0.0:1788263314.665438:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:0.0:1788263314.665449:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735900800:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263314.665542:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735900800:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 95us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263314.665550:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:0.0:1788263314.665568:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:0.0:1788263314.665574:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735900672:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263314.665599:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735900672:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (3084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263314.665606:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00080000:3.0:1788263314.666254:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263314.666653:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735900544 00000100:00100000:1.0:1788263314.666663:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735900544 00000100:00100000:1.0:1788263314.666715:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735900928 00000100:00100000:1.0:1788263314.666717:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735900928 00000100:00100000:1.0:1788263314.666797:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:1.0:1788263314.666806:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+24:2361:x1875129735900544:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263314.666889:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+24:2361:x1875129735900544:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 74us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263314.666896:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:1.0:1788263314.666998:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:1.0:1788263314.667005:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735900928:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263314.667037:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735900928:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263314.667043:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00080000:0.0:1788263314.667663:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788263315.651322:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263315.869490:0:12179:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263315.869500:0:12179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263315.869546:0:12179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788263315.869552:0:12179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788263316.020402:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263316.020489:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735901184 00000100:00100000:0.0:1788263316.020503:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735901184 00000100:00100000:0.0:1788263316.020596:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:0.0:1788263316.020611:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+24:10581:x1875129735901184:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263316.020640:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263316.020666:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395643d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31f5 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.020792:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956444 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.020810:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956444 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.020836:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956444 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263316.020851:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788263316.021037:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc51395643d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31f5 expref: 27 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.021059:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956444 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31f5 expref: 26 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.021069:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263316.021072:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788263316.021077:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659400, rc 0) 00000100:00100000:0.0:1788263316.021149:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+26:10581:x1875129735901184:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 542us (759us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788263316.021158:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00080000:2.0:1788263316.021395:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263316.024425:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263316.024532:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735901312 00000100:00100000:0.0:1788263316.024545:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735901312 00000100:00100000:0.0:1788263316.024619:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:0.0:1788263316.024632:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+26:10581:x1875129735901312:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1788263316.024727:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.024749:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.024764:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.024821:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.024828:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.024835:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.024842:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263316.024848:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.024864:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.024880:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:0.0:1788263316.024884:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263316.024890:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.024896:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658c00/0x1a657bc513956452 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263316.024994:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+26:10581:x1875129735901312:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 363us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263316.025003:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:0.0:1788263316.113122:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263316.113381:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735901440 00000100:00100000:3.0:1788263316.113395:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735901440 00000100:00100000:0.0:1788263316.113559:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:0.0:1788263316.113575:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735901440:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:0.0:1788263316.113618:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263316.113645:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956459 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d31fc expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263316.113680:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a96bb90, atime: 0x6a96bb90, ctime: 0x6a96bb90, blocks: 0xb 00010000:00010000:0.0:1788263316.113705:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1788263316.113710:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263316.113721:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31fc expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.113742:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956459 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31fc expref: 7 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.113758:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658c00, rc 0) 00000100:00100000:0.0:1788263316.113830:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735901440:12345-192.168.201.29@tcp:101:cat.0 Request processed in 260us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263316.113838:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00080000:2.0:1788263316.114033:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263316.130403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263316.130768:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735901568 00000100:00100000:1.0:1788263316.130782:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735901568 00002000:00100000:1.0:1788263316.130850:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff994375ebfb80 x1875129735901568/t0(0) o3->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:527/0 lens 488/0 e 0 to 0 dl 1788263327 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788263316.130872:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994375ebfb80 with x1875129735901568 ext(0->4095) 00002000:00010000:1.0:1788263316.130879:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994375ebfb80 00000100:00100000:1.0:1788263316.130918:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1788263316.130931:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fedef325-db54-4469-b29a-301ff58466df+7:2360:x1875129735901568:12345-192.168.201.29@tcp:3:cat.0 00000100:00100000:1.0:1788263316.131261:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fedef325-db54-4469-b29a-301ff58466df+7:2360:x1875129735901568:12345-192.168.201.29@tcp:3:cat.0 Request processed in 331us (878us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788263316.131270:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00002000:00100000:1.0:1788263316.131279:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff994375ebfb80 x1875129735901568/t0(0) o3->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:527/0 lens 488/4536 e 0 to 0 dl 1788263327 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788263316.131288:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994375ebfb80 with x1875129735901568 ext(0->4095) 00002000:00010000:1.0:1788263316.131293:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994375ebfb80 00010000:00010000:1.0:1788263316.667456:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788263316.847655:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1788263316.847683:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788263316.847697:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:3.0:1788263317.244384:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753733248:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.244479:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263317.244533:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753733760:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.244564:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263317.244605:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788263317.244611:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753733120:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.244640:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263317.244728:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753733632:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.244761:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263317.244787:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753733376:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.244823:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263317.244855:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263317.244861:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753733504:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.244898:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263317.244959:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753733248 00000100:00100000:0.0:1788263317.244968:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753733248 00000100:00100000:0.0:1788263317.245011:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753733632 00000100:00100000:0.0:1788263317.245015:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753733632 00000100:00100000:0.0:1788263317.245034:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753733376 00000100:00100000:0.0:1788263317.245036:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753733376 00000100:00100000:0.0:1788263317.245061:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788263317.245069:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753733248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263317.245134:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753733248:12345-0@lo:400:kworker.0 Request processed in 65us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263317.245142:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788263317.245158:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788263317.245164:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753733632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263317.245189:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753733632:12345-0@lo:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263317.245196:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788263317.245205:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788263317.245211:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753733376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263317.245252:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753733376:12345-0@lo:400:kworker.0 Request processed in 42us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263317.245258:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788263317.245517:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263317.245631:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753733376:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.245670:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753733120 00000100:00100000:3.0:1788263317.245675:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753733120 00000100:00100000:3.0:1788263317.245716:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788263317.245724:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753733120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.245758:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753733120:12345-0@lo:400:kworker.0 Request processed in 35us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263317.245765:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788263317.246336:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753733760 00000100:00100000:1.0:1788263317.246343:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753733760 00000100:00100000:1.0:1788263317.246397:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753733504 00000100:00100000:1.0:1788263317.246400:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753733504 00000100:00080000:2.0:1788263317.246404:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263317.246407:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263317.246424:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788263317.246431:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753733760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263317.246433:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788263317.246441:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1875129753733504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263317.246473:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753733760:12345-0@lo:400:kworker.0 Request processed in 43us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.246477:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1875129753733504:12345-0@lo:400:kworker.0 Request processed in 38us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263317.246480:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788263317.246482:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788263317.246754:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753733504:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.246797:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753733120:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.246809:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753733632:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.246819:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753733248:0@lo:400:kworker.0 00000100:00100000:3.0:1788263317.246828:0:3323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788263317.246844:0:3323:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788263317.246861:0:3323:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99437f6b5c00, transno 4294967304 00000100:00100000:3.0:1788263317.246871:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753733760:0@lo:400:kworker.0 00010000:00010000:1.0:1788263317.695991:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263317.755880:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263317.755907:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753733888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263317.755997:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263317.756157:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753733888 00000100:00100000:0.0:1788263317.756167:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753733888 00000100:00100000:0.0:1788263317.756299:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788263317.756311:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753733888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263317.756347:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263317.756400:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753733888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263317.756406:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788263317.756488:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375ebf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753733888:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788263318.267873:0:6800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345055652253ns, next at 346055649587ns, rc = 0 00000100:00100000:1.0:1788263318.267908:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753734016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263318.267984:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263318.268056:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753734016 00000100:00100000:1.0:1788263318.268064:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753734016 00000100:00100000:1.0:1788263318.268107:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788263318.268115:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753734016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263318.268149:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263318.268193:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753734016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263318.268200:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788263318.268260:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753734016:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788263318.321876:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000004:00080000:1.0:1788263318.321906:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788263318.321923:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788263318.321942:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99437a573b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788263318.321947:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994375ff5800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99437a573900 00000020:00080000:1.0:1788263318.321951:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994375ff5900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99437cbb4c00 00000020:00080000:1.0:1788263318.322022:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788263318.322174:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788263318.322195:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753734144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788263318.322305:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263318.322383:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753734144 00000100:00100000:1.0:1788263318.322390:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753734144 00000100:00100000:1.0:1788263318.322449:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263318.322458:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753734144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788263318.322637:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788263318.322641:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788263312 -> 1788263312 00002000:00010000:1.0:1788263318.322643:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788263312 -> 1788263312 00002000:00010000:1.0:1788263318.322645:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788263312 -> 1788263312 00002000:00010000:1.0:1788263318.322647:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788263318.322686:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3322:x1875129753734144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (380us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788263318.322694:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1788263318.322739:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9943755ab800/2, rc 0, transno 4294967312 00000100:00100000:1.0:1788263318.322745:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753734144:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1788263318.362357:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788263318.362381:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1788263318.718561:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788263319.227714:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263319.227736:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263319.227796:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788263319.227818:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788263319.741101:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263319.789238:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263319.789277:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263319.789314:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263319.789336:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263319.789361:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263319.789389:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735902208 00000100:00100000:0.0:1788263319.789398:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735902208 00000100:00100000:0.0:1788263319.789458:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735901824 00000100:00100000:0.0:1788263319.789461:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735901824 00000100:00100000:0.0:1788263319.789487:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:0.0:1788263319.789498:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2362:x1875129735902208:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263319.789580:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2362:x1875129735902208:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.789588:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:0.0:1788263319.789605:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:0.0:1788263319.789612:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+13:2362:x1875129735901824:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263319.789637:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+13:2362:x1875129735901824:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.789644:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:0.0:1788263319.789665:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735901952 00000100:00100000:0.0:1788263319.789669:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735901952 00000100:00100000:0.0:1788263319.789695:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735902080 00000100:00100000:0.0:1788263319.789698:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735902080 00000100:00100000:0.0:1788263319.789718:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:0.0:1788263319.789725:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735901952:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263319.789760:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735901952:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.789768:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:0.0:1788263319.789780:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:0.0:1788263319.789786:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735902080:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263319.789823:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735902080:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 38us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.789829:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00080000:0.0:1788263319.789844:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263319.789849:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263319.789852:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263319.790397:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735901696 00000100:00100000:3.0:1788263319.790405:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735901696 00000100:00100000:3.0:1788263319.790444:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 284 00000100:00100000:3.0:1788263319.790453:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2362:x1875129735901696:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263319.790498:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2362:x1875129735901696:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 47us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263319.790505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 284 00000100:00100000:0.0:1788263320.173187:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263320.173414:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735902336 00000100:00100000:1.0:1788263320.173426:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735902336 00000100:00100000:1.0:1788263320.173488:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:1.0:1788263320.173498:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+13:10225:x1875129735902336:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788263320.173642:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+13:10225:x1875129735902336:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 144us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263320.173649:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:3.0:1788263320.180463:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263320.180579:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735902592 00000100:00100000:2.0:1788263320.180590:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735902592 00000100:00100000:2.0:1788263320.180651:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:2.0:1788263320.180663:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+13:10225:x1875129735902592:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788263320.181025:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+14:10225:x1875129735902592:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 364us (828us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788263320.181034:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:2.0:1788263320.421516:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263320.421591:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735902720 00000100:00100000:0.0:1788263320.421600:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735902720 00000100:00100000:0.0:1788263320.421697:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 136 00000100:00100000:0.0:1788263320.421708:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:584ba373-7851-453b-ba8f-f510758f1581+5:11034:x1875129735902720:12345-192.168.201.29@tcp:101:lsof.0 00010000:00010000:0.0:1788263320.421731:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263320.421753:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956460 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3203 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.421828:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.421841:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.421854:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263320.421901:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788263320.421905:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263320.421943:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.421967:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956460 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3203 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.421985:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3203 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.421994:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263320.421997:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263320.422001:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658600, rc 0) 00000100:00100000:0.0:1788263320.422085:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:584ba373-7851-453b-ba8f-f510758f1581+6:11034:x1875129735902720:12345-192.168.201.29@tcp:101:lsof.0 Request processed in 379us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263320.422093:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 136 00010000:00010000:1.0:1788263320.764716:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263321.787553:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263322.365825:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753734400:0@lo:400:kworker.0 00000100:00100000:2.0:1788263322.365910:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263322.365992:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753734912:0@lo:400:kworker.0 00000100:00100000:2.0:1788263322.366033:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263322.366070:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263322.366076:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753734528:0@lo:400:kworker.0 00000100:00100000:2.0:1788263322.366102:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263322.366133:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753734912 00000100:00100000:2.0:1788263322.366156:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753734912 00000100:00100000:2.0:1788263322.366213:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788263322.366242:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753734912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263322.366284:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753734912:12345-0@lo:400:kworker.0 Request processed in 45us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263322.366289:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788263322.366304:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753734400 00000100:00100000:2.0:1788263322.366307:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753734400 00000100:00100000:2.0:1788263322.366322:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753734528 00000100:00100000:2.0:1788263322.366324:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753734528 00000100:00100000:2.0:1788263322.366335:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788263322.366339:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753734400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263322.366360:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753734400:12345-0@lo:400:kworker.0 Request processed in 20us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263322.366366:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788263322.366376:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788263322.366382:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753734528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263322.366407:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753734528:12345-0@lo:400:kworker.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263322.366412:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1788263322.366429:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263322.366434:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263322.366467:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753734528:0@lo:400:kworker.0 00000100:00100000:2.0:1788263322.366473:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753734400:0@lo:400:kworker.0 00000100:00100000:2.0:1788263322.366478:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753734912:0@lo:400:kworker.0 00000100:00100000:1.0:1788263322.366656:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753734272:0@lo:400:kworker.0 00000100:00100000:1.0:1788263322.366683:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263322.366714:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753734784:0@lo:400:kworker.0 00000100:00100000:1.0:1788263322.366738:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263322.366770:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263322.366776:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753734656:0@lo:400:kworker.0 00000100:00100000:1.0:1788263322.366799:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263322.366825:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753734784 00000100:00100000:1.0:1788263322.366828:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753734784 00000100:00100000:0.0:1788263322.366831:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753734656 00000100:00100000:0.0:1788263322.366834:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753734656 00000100:00100000:1.0:1788263322.366859:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788263322.366859:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788263322.366866:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753734784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263322.366866:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753734656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263322.366935:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753734272 00000100:00100000:3.0:1788263322.366939:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753734272 00000100:00100000:3.0:1788263322.366968:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788263322.366975:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753734272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263322.367068:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753734784:12345-0@lo:400:kworker.0 Request processed in 31us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263322.367075:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1788263322.367091:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263322.367094:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263322.367140:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753734656:12345-0@lo:400:kworker.0 Request processed in 264us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263322.367147:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788263322.367203:0:3323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788263322.367209:0:3323:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1788263322.367253:0:3323:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9943755ab800 x1875129753734144/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788263334 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263322.367263:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753734656:0@lo:400:kworker.0 00000100:00100000:3.0:1788263322.367323:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753734272:12345-0@lo:400:kworker.0 Request processed in 348us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263322.367330:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788263322.367418:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753734272:0@lo:400:kworker.0 00000100:00100000:1.0:1788263322.367428:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753734784:0@lo:400:kworker.0 00010000:00010000:1.0:1788263322.811628:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263322.875932:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943812b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753735040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263322.876025:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263322.876148:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753735040 00000100:00100000:2.0:1788263322.876161:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753735040 00000100:00100000:2.0:1788263322.876235:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788263322.876246:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753735040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263322.876283:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263322.876341:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753735040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263322.876349:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788263322.876390:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943812b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753735040:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788263323.241559:0:12380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:48:41 (1788263321) 00000100:00100000:0.0:1788263323.388375:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753735168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263323.388463:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263323.388540:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753735168 00000100:00100000:0.0:1788263323.388549:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753735168 00000100:00100000:0.0:1788263323.388598:0:11722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788263323.388609:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753735168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263323.388640:0:11722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263323.388742:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753735168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263323.388750:0:11722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788263323.389108:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753735168:0@lo:13:osp-pre-0-0.0 00000020:00080000:1.0:1788263323.434247:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000004:00080000:1.0:1788263323.434263:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:1.0:1788263323.434278:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788263323.434293:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788263323.434303:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1788263323.451841:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:1.0:1788263323.835589:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263324.620512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263324.620632:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735902976 00000100:00100000:1.0:1788263324.620642:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735902976 00000100:00100000:1.0:1788263324.620746:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:1.0:1788263324.620758:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+13:11299:x1875129735902976:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263324.620793:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263324.620813:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc51395646e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d320a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.620890:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.620905:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.620919:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.620933:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.620940:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.620962:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.621329:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956483 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788263324.621429:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788263324.621830:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956483 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.621839:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956483 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263324.621850:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788263324.622005:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.622014:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.622021:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.622026:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263324.622030:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.622038:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.622050:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994344cabf00) 00010000:00010000:1.0:1788263324.622053:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263324.622065:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.624482:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956475 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.624508:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.624515:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.624521:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.624527:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263324.624531:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.624539:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.624555:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9943565b5f00) 00010000:00010000:1.0:1788263324.624558:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263324.624563:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.624568:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc51395647c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.625087:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc51395646e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d320a expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.625116:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956483 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d320a expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263324.625124:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:1.0:1788263324.625126:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263324.625129:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158400, rc 0) 00000100:00100000:1.0:1788263324.627228:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+15:11299:x1875129735902976:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 6452us (6704us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788263324.627241:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:3.0:1788263324.643099:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263324.643148:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263324.643269:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735903104 00000100:00100000:0.0:1788263324.643278:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735903104 00000100:00100000:0.0:1788263324.643349:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:0.0:1788263324.643359:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+15:2361:x1875129735903104:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263324.643376:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263324.643402:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc513956483 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d320a expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263324.643422:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:0.0:1788263324.643427:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263324.643493:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+14:2361:x1875129735903104:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 134us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263324.643500:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788263324.645258:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735903232 00000100:00100000:1.0:1788263324.645270:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735903232 00000100:00100000:1.0:1788263324.645346:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 138 00000100:00100000:1.0:1788263324.645356:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+14:11299:x1875129735903232:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788263324.645473:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+14:11299:x1875129735903232:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 118us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263324.645480:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 138 00010000:00010000:1.0:1788263324.862856:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263324.913936:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263324.914384:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263324.914581:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735903360 00000100:00100000:3.0:1788263324.914592:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735903360 00000100:00100000:3.0:1788263324.914643:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 286 00000100:00100000:3.0:1788263324.914653:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735903360:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263324.914743:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735903360:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.914750:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 286 00000100:00100000:2.0:1788263324.914993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263324.915256:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263324.924184:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735903744 00000100:00100000:3.0:1788263324.924201:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735903744 00000100:00100000:3.0:1788263324.924315:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:3.0:1788263324.924327:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+6:2359:x1875129735903744:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263324.924426:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+6:2359:x1875129735903744:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 101us (9433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.924435:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:0.0:1788263324.929953:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735903488 00000100:00100000:0.0:1788263324.929974:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735903488 00000100:00080000:0.0:1788263324.930021:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263324.930272:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263324.930316:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735903616 00000100:00100000:0.0:1788263324.930321:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735903616 00000100:00100000:0.0:1788263324.930352:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:0.0:1788263324.930362:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735903488:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263324.930445:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735903488:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 84us (16517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263324.930453:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:0.0:1788263324.930468:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1788263324.930475:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+5:2360:x1875129735903616:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263324.930498:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+5:2360:x1875129735903616:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (15243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263324.930505:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00080000:0.0:1788263324.930518:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788263325.371451:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263325.371461:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263325.372170:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788263325.372190:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788263325.885728:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263326.291030:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263326.291112:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735903872 00000100:00100000:1.0:1788263326.291123:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735903872 00000100:00100000:1.0:1788263326.291204:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 139 00000100:00100000:1.0:1788263326.291240:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+14:11341:x1875129735903872:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263326.291264:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263326.291286:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956491 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3211 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291369:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291384:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291398:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291412:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291420:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291427:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291746:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291755:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291762:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291768:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263326.291772:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291787:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291800:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:1.0:1788263326.291803:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263326.291808:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291813:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513956498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291824:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291829:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291835:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291839:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263326.291842:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291847:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291853:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9943565b5f00) 00010000:00010000:1.0:1788263326.291855:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263326.291857:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291870:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395649f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291903:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956491 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3211 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291913:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:1.0:1788263326.291916:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263326.291919:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc513956491 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3211 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.291928:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159a00, rc 0) 00000100:00100000:1.0:1788263326.291995:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+14:11341:x1875129735903872:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 781us (974us total) trans 0 rc 301/301 00000100:00100000:1.0:1788263326.292002:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 139 00000100:00080000:2.0:1788263326.292253:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263326.298369:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263326.298444:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735904128 00000100:00100000:1.0:1788263326.298456:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735904128 00000100:00100000:1.0:1788263326.298517:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 140 00000100:00100000:1.0:1788263326.298528:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+14:11341:x1875129735904128:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:1.0:1788263326.298583:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263326.298609:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513955e0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d304a expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.298629:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:1.0:1788263326.298634:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263326.298840:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.298859:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3203 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.298868:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.298902:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3203 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.298917:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3203 expref: 5 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263326.298932:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753735296:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263326.299035:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943509c0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263326.316040:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263326.316075:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735904256 00000100:00100000:0.0:1788263326.316083:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735904256 00010000:00010000:0.0:1788263326.316137:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3203 expref: 6 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263326.316171:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:0.0:1788263326.316181:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:584ba373-7851-453b-ba8f-f510758f1581+6:2362:x1875129735904256:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263326.316205:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263326.316212:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3203 expref: 6 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.316249:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3203 expref: 6 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.316275:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263326.316281:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.316292:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.316301:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.316321:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263326.316374:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:584ba373-7851-453b-ba8f-f510758f1581+6:2362:x1875129735904256:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 194us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263326.316382:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00080000:0.0:1788263326.316466:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788263326.316554:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc513956467 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3203 expref: 5 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263326.316572:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753735296:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263326.316592:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.316600:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.316606:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.316628:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.316644:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.316652:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263326.317735:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788263326.317748:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.317756:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.317764:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.317770:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263326.317774:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.317783:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.317796:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263326.317799:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263326.317804:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.317811:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139564a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263326.317841:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9f9fa6e reply state 0000000069169440 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263326.317850:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263326.317949:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+15:11341:x1875129735904128:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 19421us (19587us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788263326.317957:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 140 00010000:00010000:2.0:1788263326.335320:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.335338:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.335346:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.335353:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263326.335358:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.335366:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.335384:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99434314f500) 00010000:00010000:2.0:1788263326.335388:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263326.335392:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.335398:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139564ad lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263326.414717:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263326.415064:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735904384 00000100:00100000:1.0:1788263326.415074:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735904384 00000100:00100000:1.0:1788263326.415132:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:1.0:1788263326.415143:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+14:11349:x1875129735904384:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:1.0:1788263326.415167:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263326.415189:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139564b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3218 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.415957:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139564bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.415975:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139564bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.416003:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139564bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263326.416040:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788263326.416044:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263326.416067:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139564bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.416094:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139564b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3218 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.416111:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139564bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3218 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.416121:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5f00) 00010000:00010000:1.0:1788263326.416124:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263326.416127:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158000, rc 0) 00000100:00100000:1.0:1788263326.416245:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+15:11349:x1875129735904384:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 1103us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263326.416253:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:1.0:1788263326.466983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263326.467087:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735904512 00000100:00100000:0.0:1788263326.467097:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735904512 00000100:00100000:0.0:1788263326.467159:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00100000:0.0:1788263326.467169:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+15:11355:x1875129735904512:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788263326.467190:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263326.467211:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139564c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d321f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467337:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467350:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467362:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467380:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467387:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467392:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467502:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139564d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467511:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139564d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467518:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139564d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263326.467546:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788263326.467550:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263326.467568:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139564d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467602:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467608:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467616:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467622:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263326.467626:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467634:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467646:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5f00) 00010000:00010000:0.0:1788263326.467649:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263326.467654:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467659:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc5139564c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467681:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467687:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467693:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467704:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263326.467707:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467713:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467721:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff994344cabe00) 00010000:00010000:0.0:1788263326.467723:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263326.467726:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467731:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139564d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467761:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139564c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d321f expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467774:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139564d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d321f expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.467781:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263326.467783:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788263326.467786:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658600, rc 0) 00000100:00100000:0.0:1788263326.467853:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+16:11355:x1875129735904512:12345-192.168.201.29@tcp:101:bash.0 Request processed in 685us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263326.467861:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00100000:0.0:1788263326.475254:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.475388:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735904768 00000100:00100000:3.0:1788263326.475398:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735904768 00000100:00100000:3.0:1788263326.475457:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 143 00000100:00100000:3.0:1788263326.475467:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+16:11355:x1875129735904768:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788263326.475487:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263326.475508:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139564de lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3226 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.475640:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.475654:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.475685:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.475703:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.475711:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.475719:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263326.476360:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788263326.476524:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476535:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476543:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476575:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476584:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476590:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476597:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263326.476607:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476615:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476628:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263326.476631:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263326.476635:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476640:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139564e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263326.476653:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008557cdb6 reply state 00000000324cdc8f transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263326.476662:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788263326.476701:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139564de lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3226 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476715:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3226 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.476724:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:3.0:1788263326.476727:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263326.476729:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216de00, rc 0) 00000100:00100000:3.0:1788263326.476921:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+19:11355:x1875129735904768:12345-192.168.201.29@tcp:101:bash.0 Request processed in 1454us (1711us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788263326.476929:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 143 00010000:00010000:0.0:1788263326.480638:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.480656:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.480664:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.480671:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263326.480685:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.480692:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.480710:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994352cd3700) 00010000:00010000:0.0:1788263326.480713:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263326.480718:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.480724:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139564ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263326.481393:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263326.481472:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735904896 00000100:00100000:1.0:1788263326.481481:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735904896 00000100:00100000:1.0:1788263326.481553:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1788263326.481563:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735904896:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263326.481586:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263326.481607:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d322d expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263326.481646:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263326.481664:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1788263326.481669:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263326.481686:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d322d expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.481705:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d322d expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.481718:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158600, rc 0) 00000100:00100000:1.0:1788263326.481776:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735904896:12345-192.168.201.29@tcp:101:bash.0 Request processed in 214us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263326.481783:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00080000:0.0:1788263326.481971:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263326.484347:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263326.487156:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735905024 00000100:00100000:0.0:1788263326.487171:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735905024 00000100:00100000:1.0:1788263326.489375:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1788263326.489390:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+6:11355:x1875129735905024:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263326.489411:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263326.489431:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3234 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.489466:0:8112:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d322d expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.489475:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263326.489494:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263326.489500:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.489538:0:8112:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d322d expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.489554:0:8112:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d322d expref: 7 pid: 6704 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263326.489569:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8112:1875129753735424:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263326.489686:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943509c06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263326.492171:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8112:1875129753735424:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263326.492209:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 7 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.492272:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158400, rc 0) 00000100:00100000:2.0:1788263326.492333:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+7:11355:x1875129735905024:12345-192.168.201.29@tcp:101:bash.0 Request processed in 2945us (7991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263326.492343:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1788263326.492983:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.493145:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735905152 00000100:00100000:3.0:1788263326.493153:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735905152 00010000:00010000:3.0:1788263326.493190:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d322d expref: 7 pid: 6704 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263326.493262:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:3.0:1788263326.493273:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735905152:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263326.493286:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263326.493309:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d322d expref: 7 pid: 6704 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.493322:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d322d expref: 7 pid: 6704 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.493344:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc513956501 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d322d expref: 7 pid: 6704 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.493359:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263326.493364:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263326.493373:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 6 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.493384:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 6 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.493422:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 6 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263326.493964:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5838:1875129753735552:192.168.201.29@tcp:105: 00000100:00100000:3.0:1788263326.494061:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263326.499075:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eeca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5838:1875129753735552:192.168.201.29@tcp:105: 00010000:00010000:3.0:1788263326.499106:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263326.499171:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735905152:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 5898us (6199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263326.499183:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:1.0:1788263326.502533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.502710:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735905408 00000100:00100000:3.0:1788263326.502720:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735905408 00000100:00100000:3.0:1788263326.502778:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1788263326.502788:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+18:11355:x1875129735905408:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:3.0:1788263326.503186:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+19:11355:x1875129735905408:12345-192.168.201.29@tcp:35:bash.0 Request processed in 397us (660us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788263326.503195:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:0.0:1788263326.584002:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.584102:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735905664 00000100:00100000:3.0:1788263326.584113:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735905664 00000100:00100000:3.0:1788263326.584185:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 144 00000100:00100000:3.0:1788263326.584193:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:11365:x1875129735905664:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263326.584255:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263326.584279:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395650f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d323b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263326.584384:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788263326.584487:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395650f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d323b expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.584512:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5f00) 00010000:00010000:3.0:1788263326.584514:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263326.584518:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395650f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d323b expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.584529:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ce00, rc 0) 00000100:00100000:3.0:1788263326.584600:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+20:11365:x1875129735905664:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 407us (607us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788263326.584607:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 144 00000100:00100000:1.0:1788263326.588055:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263326.588161:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735905920 00000100:00100000:2.0:1788263326.588171:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735905920 00000100:00100000:3.0:1788263326.588351:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1788263326.588364:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+20:11365:x1875129735905920:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1788263326.588602:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+21:11365:x1875129735905920:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 240us (556us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788263326.588609:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:0.0:1788263326.656720:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263326.656869:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735906048 00000100:00100000:1.0:1788263326.656879:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735906048 00000100:00100000:1.0:1788263326.656944:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:1.0:1788263326.656955:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+21:11371:x1875129735906048:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263326.656980:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263326.657004:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395651d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3242 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.657087:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513956524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.657101:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513956524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.657125:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513956524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263326.657162:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788263326.657166:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263326.657182:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513956524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.657210:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395651d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3242 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.657258:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513956524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3242 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.657266:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:1.0:1788263326.657269:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263326.657272:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159600, rc 0) 00000100:00100000:1.0:1788263326.657341:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+22:11371:x1875129735906048:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 389us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263326.657348:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:0.0:1788263326.680810:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.680909:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735906304 00000100:00100000:3.0:1788263326.680920:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735906304 00000100:00100000:3.0:1788263326.680991:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 146 00000100:00100000:3.0:1788263326.681002:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+22:11371:x1875129735906304:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263326.681026:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263326.681048:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395652b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3249 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.681164:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.681195:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.681208:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263326.681251:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788263326.681388:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395652b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3249 expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.681415:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3249 expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.681425:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:3.0:1788263326.681427:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263326.681430:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ca00, rc 0) 00000100:00100000:3.0:1788263326.681504:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+24:11371:x1875129735906304:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 504us (704us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788263326.681512:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 146 00000100:00100000:2.0:1788263326.691060:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.691414:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735906432 00000100:00100000:3.0:1788263326.691426:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735906432 00000100:00100000:3.0:1788263326.691502:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788263326.691513:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+24:2361:x1875129735906432:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263326.691529:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263326.691554:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3249 expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.691592:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:3.0:1788263326.691597:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263326.691664:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+23:2361:x1875129735906432:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 151us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263326.691680:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788263326.702878:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263326.705505:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735906688 00000100:00100000:1.0:1788263326.705522:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735906688 00000100:00100000:1.0:1788263326.705608:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00100000:1.0:1788263326.705621:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+23:11371:x1875129735906688:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263326.705649:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263326.705682:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3250 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.705806:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956547 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.705821:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.705849:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263326.705863:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788263326.706393:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513956540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3250 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.706418:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3250 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.706429:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:1.0:1788263326.706432:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788263326.706436:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158600, rc 0) 00000100:00100000:1.0:1788263326.706528:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+25:11371:x1875129735906688:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 910us (3664us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788263326.706536:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00100000:2.0:1788263326.722418:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263326.722521:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735906816 00000100:00100000:1.0:1788263326.722531:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735906816 00000100:00100000:1.0:1788263326.722612:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1788263326.722623:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735906816:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:1.0:1788263326.722683:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.722720:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 6 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.722728:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263326.722734:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263326.722738:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.722775:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 6 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.722790:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 6 pid: 8112 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263326.722805:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875129753735680:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263326.722925:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943509c0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263326.729076:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263326.729311:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735906944 00000100:00100000:0.0:1788263326.729321:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735906944 00002000:00100000:0.0:1788263326.729386:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff994375bfad80 x1875129735906944/t0(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:537/0 lens 504/0 e 0 to 0 dl 1788263337 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263326.729399:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994375bfad80 with x1875129735906944 ext(0->12) 00010000:00010000:0.0:1788263326.729409:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 7 pid: 8112 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.729428:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 7 pid: 8112 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263326.729436:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994375bfad80 00000100:00100000:0.0:1788263326.729474:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1788263326.729486:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735906944:12345-192.168.201.29@tcp:4:lfs.0 00000100:00100000:0.0:1788263326.730072:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+9:2362:x1875129735906944:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 586us (1005us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788263326.730082:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00002000:00100000:0.0:1788263326.730090:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff994375bfad80 x1875129735906944/t4294967305(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:537/0 lens 504/448 e 0 to 0 dl 1788263337 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263326.730100:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994375bfad80 with x1875129735906944 ext(0->12) 00010000:00010000:0.0:1788263326.730107:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 9 pid: 8112 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.730121:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 9 pid: 8112 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263326.730963:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff994375bfad80 00000100:00100000:1.0:1788263326.731077:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875129753735680:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263326.731110:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263326.734950:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.735732:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735907072 00000100:00100000:3.0:1788263326.735747:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735907072 00010000:00010000:3.0:1788263326.735790:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 9 pid: 8112 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263326.736303:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:3.0:1788263326.736316:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+9:2360:x1875129735907072:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263326.736332:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788263326.736353:0:8471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788263326.736356:0:8471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788263326 00002000:00010000:3.0:1788263326.736359:0:8471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788263326 00002000:00010000:3.0:1788263326.736361:0:8471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788263326 00010000:00010000:3.0:1788263326.736367:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 9 pid: 8112 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.736381:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 9 pid: 8112 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.736404:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007332f49c/0x1a657bc513956508 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3234 expref: 9 pid: 8112 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.736443:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263326.736448:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263326.736455:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.736465:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.736504:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263326.736590:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+8:2360:x1875129735907072:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 276us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263326.736598:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00010000:00010000:0.0:1788263326.736665:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.736685:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.736712:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.736720:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.736728:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.736735:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263326.736739:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.736747:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.736759:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.736775:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc513956555 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263326.737791:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735906816:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 14203us (14418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263326.737814:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:2.0:1788263326.742550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.742876:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735907328 00000100:00100000:3.0:1788263326.742889:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735907328 00000100:00100000:3.0:1788263326.742946:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:3.0:1788263326.742958:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+25:11371:x1875129735907328:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:3.0:1788263326.743025:0:5856:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3250 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263326.743608:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788263326.743681:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788263326.744349:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788263326.744440:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.744458:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3226 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.744466:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.744506:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3226 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.744530:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3226 expref: 29 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263326.744547:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1875129753735808:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263326.744712:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263326.747035:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263326.747161:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1875129753735808:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263326.747193:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263326.747196:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735907456 00000100:00100000:3.0:1788263326.747206:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735907456 00010000:00010000:3.0:1788263326.747269:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3226 expref: 30 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263326.747375:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:3.0:1788263326.747386:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+30:2361:x1875129735907456:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263326.747407:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263326.747414:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3226 expref: 30 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.747429:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3226 expref: 30 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.747452:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139564f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3226 expref: 30 pid: 5854 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.747469:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:3.0:1788263326.747474:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.747484:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.747491:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.747521:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263326.747585:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc90450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+29:2361:x1875129735907456:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 200us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263326.747592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00010000:00010000:2.0:1788263326.747806:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263326.747815:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263326.747937:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788263326.749339:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788263326.749494:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875129753735936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788263326.749567:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263326.749613:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788263326.751237:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753735936 00000100:00100000:3.0:1788263326.751251:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753735936 00000100:00100000:3.0:1788263326.751328:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263326.751339:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1875129753735936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788263326.751455:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1875129753735936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263326.751476:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788263326.751553:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263326.751733:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875129753735936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788263326.755618:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788263326.755741:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875129753736064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788263326.755835:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263326.755872:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263326.755893:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753736064 00000100:00100000:1.0:1788263326.755903:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753736064 00000100:00100000:1.0:1788263326.755958:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263326.755970:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1875129753736064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788263326.756213:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1875129753736064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 244us (387us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788263326.756252:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788263326.758006:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875129753736064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788263326.758197:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788263326.758414:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.758426:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.758433:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.758439:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263326.758443:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.758451:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.758467:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:0.0:1788263326.758470:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788263326.758473:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263326.758496:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395655c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263326.759010:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788263326.759132:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788263326.759143:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353546924571ns, next at 354546922442ns, rc = 0 00000001:00080000:0.0:1788263326.759150:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788263326.759187:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:0.0:1788263326.759191:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788263326.759199:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc513956547 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3250 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263326.759577:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+32:11371:x1875129735907328:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 16611us (17027us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788263326.759588:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000020:00080000:0.0:1788263326.759594:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788263326.763738:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263326.764787:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735907584 00000100:00100000:1.0:1788263326.764801:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735907584 00000100:00100000:1.0:1788263326.764870:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 148 00000100:00100000:1.0:1788263326.764884:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+32:11371:x1875129735907584:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263326.764912:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263326.764937:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3257 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.765005:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956563 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3257 expref: 33 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.765020:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956563 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3257 expref: 33 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.765039:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:1.0:1788263326.765042:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788263326.765046:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159c00, rc 0) 00000100:00100000:1.0:1788263326.765319:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+33:11371:x1875129735907584:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 437us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263326.765344:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 148 00000100:00100000:1.0:1788263326.772809:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263326.772947:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735907840 00000100:00100000:2.0:1788263326.772957:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735907840 00000100:00100000:2.0:1788263326.773031:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1788263326.773057:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+33:11371:x1875129735907840:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263326.773353:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+34:11371:x1875129735907840:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 297us (553us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788263326.773361:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1788263326.859885:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.860042:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735908096 00000100:00100000:3.0:1788263326.860053:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735908096 00000100:00100000:3.0:1788263326.860119:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00100000:3.0:1788263326.860130:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+34:11381:x1875129735908096:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263326.860165:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263326.860190:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395656a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d325e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263326.860331:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788263326.860468:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395656a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d325e expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.860483:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5f00) 00010000:00010000:3.0:1788263326.860486:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263326.860491:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395656a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d325e expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.860509:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216de00, rc 0) 00000100:00100000:3.0:1788263326.860581:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+35:11381:x1875129735908096:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 440us (695us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788263326.860588:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00100000:1.0:1788263326.865105:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.865439:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735908224 00000100:00100000:3.0:1788263326.865451:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735908224 00000100:00100000:3.0:1788263326.865513:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 150 00000100:00100000:3.0:1788263326.865538:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+35:11381:x1875129735908224:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1788263326.865634:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865651:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865663:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865688:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865695:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865702:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865804:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865812:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865820:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263326.865864:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865876:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865887:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865894:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865900:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263326.865904:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865911:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865923:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263326.865926:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263326.865930:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865936:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865948:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865955:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865961:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865967:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263326.865987:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.865993:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.866002:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994352cd3c00) 00010000:00010000:3.0:1788263326.866005:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263326.866007:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.866013:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395657f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.866029:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.866035:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.866042:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.866046:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263326.866049:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.866055:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.866062:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263326.866064:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263326.866075:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.866081:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956586 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263326.866167:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+35:11381:x1875129735908224:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 630us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263326.866176:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 150 00000100:00100000:0.0:1788263326.871664:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263326.871891:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735908480 00000100:00100000:2.0:1788263326.871903:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735908480 00000100:00100000:2.0:1788263326.871965:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:2.0:1788263326.871988:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+35:11381:x1875129735908480:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263326.872473:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+36:11381:x1875129735908480:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 485us (817us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788263326.872482:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00010000:00010000:1.0:1788263326.907476:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263326.919530:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.919797:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735908736 00000100:00100000:3.0:1788263326.919808:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735908736 00000100:00100000:3.0:1788263326.919934:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 151 00000100:00100000:3.0:1788263326.919945:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+36:11384:x1875129735908736:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263326.919984:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263326.920009:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395658d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3265 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923333:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923360:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923388:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923407:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923415:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923443:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923576:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923585:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923592:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263326.923603:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788263326.923866:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923874:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923882:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923888:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263326.923893:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923900:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923913:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263326.923916:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263326.923927:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923933:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956594 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923948:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923954:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923960:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.923966:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263326.923969:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.924203:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.924215:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994352cd3c00) 00010000:00010000:3.0:1788263326.924334:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263326.924338:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.924345:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395659b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.924407:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395658d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3265 expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.924437:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3265 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.924445:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263326.924447:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263326.924450:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d200, rc 0) 00000100:00100000:3.0:1788263326.924537:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+38:11384:x1875129735908736:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 4593us (5018us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788263326.924546:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 151 00000100:00100000:1.0:1788263326.929525:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263326.929627:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735908864 00000100:00100000:3.0:1788263326.929647:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735908864 00000100:00100000:3.0:1788263326.929769:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 152 00000100:00100000:3.0:1788263326.929781:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+38:11384:x1875129735908864:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:3.0:1788263326.929855:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.929874:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.929887:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.929915:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.929922:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.929946:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.929952:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263326.929957:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.929964:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.929976:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263326.929979:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263326.929984:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263326.929991:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139565b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263326.930130:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+38:11384:x1875129735908864:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 351us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263326.930148:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 152 00000100:00100000:0.0:1788263326.937870:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263326.937964:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735909120 00000100:00100000:2.0:1788263326.937975:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735909120 00000100:00100000:2.0:1788263326.938071:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:2.0:1788263326.938083:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+38:11384:x1875129735909120:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263326.938357:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+39:11384:x1875129735909120:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 276us (634us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788263326.938363:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000001:00080000:3.0:1788263327.053396:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1788263327.053628:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1788263327.163752:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263327.163841:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735909376 00000100:00100000:1.0:1788263327.163854:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735909376 00000100:00100000:1.0:1788263327.163926:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 153 00000100:00100000:1.0:1788263327.163936:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+39:11415:x1875129735909376:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:1.0:1788263327.163958:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263327.163978:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d326c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.164077:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.164091:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.164102:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263327.164114:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788263327.164274:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d326c expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.164291:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d326c expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.164317:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:1.0:1788263327.164320:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263327.164323:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158400, rc 0) 00000100:00100000:1.0:1788263327.164386:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+41:11415:x1875129735909376:12345-192.168.201.29@tcp:101:cat.0 Request processed in 451us (642us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788263327.164394:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 153 00000100:00100000:1.0:1788263327.170192:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263327.170344:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263327.170525:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735909760 00000100:00100000:2.0:1788263327.170539:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735909760 00000100:00100000:0.0:1788263327.170636:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735909632 00000100:00100000:0.0:1788263327.170640:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735909632 00000100:00100000:0.0:1788263327.170695:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1788263327.170706:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+42:11415:x1875129735909632:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:2.0:1788263327.171030:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788263327.171040:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+43:2361:x1875129735909760:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263327.171053:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263327.171077:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d326c expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.171114:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:2.0:1788263327.171119:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263327.171188:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+42:2361:x1875129735909760:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 150us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263327.171196:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788263327.171312:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+41:11415:x1875129735909632:12345-192.168.201.29@tcp:35:cat.0 Request processed in 607us (1128us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788263327.171329:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1788263327.250593:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263327.250667:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735910016 00000100:00100000:1.0:1788263327.250679:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735910016 00000100:00100000:1.0:1788263327.250743:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 154 00000100:00100000:1.0:1788263327.250754:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+41:11421:x1875129735910016:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:1.0:1788263327.250784:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263327.250788:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788263327.250823:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc513956524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3242 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.250843:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:1.0:1788263327.250848:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263327.250861:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3273 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.250970:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.251163:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3265 expref: 41 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.251185:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.251395:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3265 expref: 41 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.251410:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3265 expref: 41 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263327.251425:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753736192:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263327.251614:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943469f7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788263327.255274:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263327.255769:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735910144 00000100:00100000:0.0:1788263327.255778:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735910144 00010000:00010000:0.0:1788263327.255822:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3265 expref: 42 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263327.255858:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:0.0:1788263327.255869:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+42:2361:x1875129735910144:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263327.255894:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263327.255902:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3265 expref: 42 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263327.255916:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3265 expref: 42 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263327.255938:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:0.0:1788263327.255943:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263327.255953:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263327.255959:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263327.255990:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263327.256040:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+42:2361:x1875129735910144:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 174us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263327.256060:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00010000:00010000:2.0:1788263327.258973:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139565a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3265 expref: 41 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263327.259012:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753736192:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263327.259038:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.259046:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.259050:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263327.259073:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788263327.259330:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3273 expref: 42 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.259344:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3273 expref: 41 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.259350:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:2.0:1788263327.259427:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788263327.259430:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159a00, rc 0) 00000100:00100000:2.0:1788263327.259833:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+41:11421:x1875129735910016:12345-192.168.201.29@tcp:101:dd.0 Request processed in 9078us (9246us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788263327.259841:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 154 00000100:00100000:3.0:1788263327.265338:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263327.265656:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735910400 00000100:00100000:1.0:1788263327.265674:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735910400 00000100:00100000:1.0:1788263327.265739:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 155 00000100:00100000:1.0:1788263327.265751:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+41:11421:x1875129735910400:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:1.0:1788263327.266179:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.266197:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.266210:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263327.266329:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788263327.266348:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e68f518 reply state 00000000fbb40375 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263327.266355:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263327.266473:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+44:11421:x1875129735910400:12345-192.168.201.29@tcp:36:dd.0 Request processed in 723us (1145us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788263327.266478:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 155 00000020:00080000:1.0:1788263327.266482:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788263327.276718:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.276737:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.276745:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.276751:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263327.276755:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.276762:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.276781:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:2.0:1788263327.276785:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263327.276790:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.276796:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263327.495160:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753736448:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.495260:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263327.495330:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753736960:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.495357:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263327.495397:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263327.495404:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753736576:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.495428:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263327.495463:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753736704:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.495487:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263327.495507:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788263327.495514:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753736320:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.495541:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263327.495576:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753736832:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.495596:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263327.495623:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753736960 00000100:00100000:1.0:1788263327.495630:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753736960 00000100:00100000:1.0:1788263327.495685:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753736704 00000100:00100000:1.0:1788263327.495689:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753736704 00000100:00100000:1.0:1788263327.495731:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788263327.495741:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753736960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.495793:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753736960:12345-0@lo:400:kworker.0 Request processed in 52us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263327.495800:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788263327.495831:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788263327.495837:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753736704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496097:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753736704:12345-0@lo:400:kworker.0 Request processed in 35us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263327.496106:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788263327.496127:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753736320 00000100:00100000:1.0:1788263327.496131:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753736320 00000100:00100000:1.0:1788263327.496157:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788263327.496163:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753736320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496194:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753736320:12345-0@lo:400:kworker.0 Request processed in 30us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263327.496200:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788263327.496245:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753736448 00000100:00100000:1.0:1788263327.496249:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753736448 00000100:00100000:1.0:1788263327.496269:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753736576 00000100:00100000:1.0:1788263327.496271:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753736576 00000100:00100000:1.0:1788263327.496282:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753736832 00000100:00100000:1.0:1788263327.496284:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753736832 00000100:00100000:1.0:1788263327.496297:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788263327.496302:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753736448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496328:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753736448:12345-0@lo:400:kworker.0 Request processed in 26us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263327.496334:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788263327.496344:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788263327.496348:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753736576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496370:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753736576:12345-0@lo:400:kworker.0 Request processed in 22us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263327.496386:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788263327.496398:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788263327.496404:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753736832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496431:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753736832:12345-0@lo:400:kworker.0 Request processed in 28us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263327.496437:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1788263327.496456:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263327.496460:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263327.496489:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753736320:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496501:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347207100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753736832:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496509:0:3322:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788263327.496514:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9943755ab800, transno 4294967312 00000100:00100000:1.0:1788263327.496523:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753736704:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496811:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753736576:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496821:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753736448:0@lo:400:kworker.0 00000100:00100000:1.0:1788263327.496829:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788263327.496833:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788263327.496849:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753736960:0@lo:400:kworker.0 00000100:00100000:3.0:1788263327.575395:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263327.579262:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735910528 00000100:00100000:1.0:1788263327.579277:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735910528 00000100:00100000:1.0:1788263327.579356:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 156 00000100:00100000:1.0:1788263327.579368:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+43:11436:x1875129735910528:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:1.0:1788263327.579393:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263327.579432:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139565e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d327a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579507:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579522:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579533:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579547:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579567:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579574:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579691:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579702:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3273 expref: 44 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579710:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579746:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3273 expref: 44 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.579771:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3273 expref: 44 pid: 6725 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263327.579786:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753737088:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263327.579925:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943469f7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263327.587170:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753737088:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263327.587263:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263327.588976:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263327.589144:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735910784 00000100:00100000:2.0:1788263327.589153:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735910784 00000100:00100000:2.0:1788263327.589260:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:2.0:1788263327.589284:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+45:5597:x1875129735910784:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788263327.589629:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+46:5597:x1875129735910784:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 347us (660us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788263327.589637:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:1.0:1788263327.592292:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263327.592422:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735910912 00000100:00100000:3.0:1788263327.592434:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735910912 00010000:00010000:3.0:1788263327.592472:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3273 expref: 46 pid: 6725 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263327.592525:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:3.0:1788263327.592535:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+46:2361:x1875129735910912:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263327.592550:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263327.592883:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3273 expref: 46 pid: 6725 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.592899:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3273 expref: 46 pid: 6725 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.592924:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159a00/0x1a657bc5139565d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3273 expref: 46 pid: 6725 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.592942:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263327.592947:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.592956:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.592964:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.593016:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263327.593081:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+45:2361:x1875129735910912:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 546us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263327.593090:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00010000:00010000:1.0:1788263327.593254:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593262:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263327.593316:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788263327.593321:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263327.593342:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593354:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593363:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593369:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593375:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593380:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263327.593391:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593399:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593410:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:1.0:1788263327.593413:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263327.593417:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593423:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158600/0x1a657bc5139565ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593433:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593439:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593445:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593449:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263327.593451:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593456:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593463:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9943565b5100) 00010000:00010000:1.0:1788263327.593465:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263327.593473:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593478:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139565f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593524:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159600/0x1a657bc5139565e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d327a expref: 45 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593536:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d327a expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263327.593543:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:1.0:1788263327.593545:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263327.593547:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158800, rc 0) 00000100:00100000:1.0:1788263327.593587:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+44:11436:x1875129735910528:12345-192.168.201.29@tcp:101:stat.0 Request processed in 14221us (18203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263327.593593:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 156 00000100:00100000:1.0:1788263327.691342:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263327.691443:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735911168 00000100:00100000:3.0:1788263327.691455:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735911168 00000100:00100000:3.0:1788263327.691525:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 157 00000100:00100000:3.0:1788263327.691536:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+44:11442:x1875129735911168:12345-192.168.201.29@tcp:36:truncate.0 00010000:00010000:3.0:1788263327.691600:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263327.691629:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139565fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d327a expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.691649:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263327.691668:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263327.691884:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.691896:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.691905:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263327.691955:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788263327.691978:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc0dc1a7 reply state 000000007bc95a8f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263327.691987:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263327.692161:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+46:11442:x1875129735911168:12345-192.168.201.29@tcp:36:truncate.0 Request processed in 626us (828us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788263327.692169:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 157 00000020:00080000:3.0:1788263327.692174:0:6725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788263327.694258:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.694450:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.694459:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.694465:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263327.694469:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.694477:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.694495:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263327.694498:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263327.694502:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263327.694508:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956604 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263327.880856:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263327.881059:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735911296 00000100:00100000:2.0:1788263327.881071:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735911296 00000100:00100000:2.0:1788263327.881132:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 158 00000100:00100000:2.0:1788263327.881143:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+45:11456:x1875129735911296:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:2.0:1788263327.881166:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263327.881188:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc51395660b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3281 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881287:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881303:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881315:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881330:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881338:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881443:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881686:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881698:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881705:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263327.881747:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788263327.881751:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263327.881775:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881787:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881795:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881800:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881807:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881812:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263327.881817:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881824:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881845:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:2.0:1788263327.881848:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263327.881853:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881860:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881875:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881880:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881885:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881889:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263327.881891:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881896:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881903:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99434314fb00) 00010000:00010000:2.0:1788263327.881905:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263327.881907:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881913:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881960:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc51395660b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3281 expref: 47 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881973:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3281 expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263327.881981:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:2.0:1788263327.881982:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263327.881985:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263327.882113:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+46:11456:x1875129735911296:12345-192.168.201.29@tcp:101:stat.0 Request processed in 971us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263327.882121:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 158 00010000:00010000:1.0:1788263327.931563:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263327.995636:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753737216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263327.995727:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788263327.995918:0:8111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354783699084ns, next at 355783696227ns, rc = 0 00000100:00100000:3.0:1788263327.996033:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753737216 00000100:00100000:3.0:1788263327.996043:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753737216 00000100:00100000:3.0:1788263327.996101:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788263327.996111:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753737216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263327.996151:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788263328.001250:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753737216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5101us (5483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263328.001267:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788263328.001782:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347205180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753737216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263328.010492:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263328.010706:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735911552 00000100:00100000:3.0:1788263328.010719:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735911552 00000100:00100000:3.0:1788263328.010805:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 159 00000100:00100000:3.0:1788263328.010818:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+46:11466:x1875129735911552:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263328.010855:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263328.010881:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3288 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263328.011007:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788263328.011132:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956627 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3288 expref: 48 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.011147:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5f00) 00010000:00010000:3.0:1788263328.011150:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263328.011154:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3288 expref: 48 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.011168:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ce00, rc 0) 00000100:00100000:3.0:1788263328.011291:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+47:11466:x1875129735911552:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 475us (812us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788263328.011298:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 159 00000100:00080000:1.0:1788263328.011951:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263328.024436:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263328.027313:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735911808 00000100:00100000:2.0:1788263328.027329:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735911808 00000100:00100000:2.0:1788263328.027414:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1788263328.027425:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2ca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+47:11466:x1875129735911808:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263328.027717:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2ca850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+48:11466:x1875129735911808:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 293us (3293us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788263328.027725:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1788263328.092200:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263328.092381:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735912064 00000100:00100000:1.0:1788263328.092391:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735912064 00000100:00100000:1.0:1788263328.092454:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 160 00000100:00100000:1.0:1788263328.092465:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+48:11472:x1875129735912064:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263328.092505:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263328.092529:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1a00/0x1a657bc513956635 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d328f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.092659:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.092674:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3281 expref: 49 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.092683:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.092719:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3281 expref: 49 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.092732:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3281 expref: 49 pid: 5852 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263328.092746:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753737344:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263328.092866:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943469f7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263328.105122:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753737344:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263328.105154:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263328.113066:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263328.113176:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735912192 00000100:00100000:0.0:1788263328.113186:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735912192 00010000:00010000:0.0:1788263328.113271:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3281 expref: 50 pid: 5852 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263328.113316:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:0.0:1788263328.113328:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+50:2362:x1875129735912192:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263328.113344:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263328.113350:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3281 expref: 50 pid: 5852 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.113365:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3281 expref: 50 pid: 5852 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.113388:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3281 expref: 50 pid: 5852 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.113406:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:0.0:1788263328.113411:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.113421:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.113450:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.113496:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263328.113568:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+49:2362:x1875129735912192:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 241us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263328.113576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00010000:00010000:1.0:1788263328.114044:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.114055:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263328.114084:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788263328.114292:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1a00/0x1a657bc513956635 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d328f expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.114310:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d328f expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.114318:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:1.0:1788263328.114320:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788263328.114323:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0800, rc 0) 00000100:00100000:1.0:1788263328.114365:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+49:11472:x1875129735912064:12345-192.168.201.29@tcp:101:bash.0 Request processed in 21902us (22175us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788263328.114373:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 160 00000100:00100000:2.0:1788263328.120885:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263328.120975:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735912448 00000100:00100000:3.0:1788263328.120987:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735912448 00000100:00100000:3.0:1788263328.121067:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 161 00000100:00100000:3.0:1788263328.121078:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+49:11472:x1875129735912448:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:3.0:1788263328.121569:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.121588:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.121600:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263328.121666:0:6725:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788263328.121694:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059960d09 reply state 00000000b25d604e transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263328.121703:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263328.122899:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+52:11472:x1875129735912448:12345-192.168.201.29@tcp:36:bash.0 Request processed in 1817us (2019us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788263328.122908:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 161 00000020:00080000:3.0:1788263328.122914:0:6725:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788263328.133402:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.133436:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.133444:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.133450:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263328.133455:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.133475:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.133492:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:2.0:1788263328.133495:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263328.133499:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.133505:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc51395664a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263328.144093:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263328.144360:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735912576 00000100:00100000:1.0:1788263328.144371:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735912576 00000100:00100000:1.0:1788263328.144428:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:1.0:1788263328.144439:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+51:11472:x1875129735912576:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263328.144468:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263328.144491:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1a00/0x1a657bc513956651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3296 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.144599:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.144615:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d328f expref: 52 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.144642:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.144692:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d328f expref: 52 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.144717:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d328f expref: 52 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263328.144732:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753737472:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263328.144821:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943469f7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263328.161941:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263328.162027:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735912704 00000100:00100000:3.0:1788263328.162037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735912704 00010000:00010000:3.0:1788263328.162078:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d328f expref: 53 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263328.162128:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:3.0:1788263328.162139:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+53:2361:x1875129735912704:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263328.162154:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263328.162161:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d328f expref: 53 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.162190:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d328f expref: 53 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.162213:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263328.162264:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.162275:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.162283:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.162306:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263328.162365:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+53:2361:x1875129735912704:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 228us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263328.162372:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00010000:00010000:2.0:1788263328.166300:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc51395663c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d328f expref: 52 pid: 5854 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263328.166329:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753737472:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263328.166354:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.166363:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.166386:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263328.166445:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788263328.166449:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263328.166485:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.166529:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1a00/0x1a657bc513956651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3296 expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.166543:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3296 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.166552:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:2.0:1788263328.166555:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263328.166558:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0c00, rc 0) 00000100:00100000:2.0:1788263328.166640:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+51:11472:x1875129735912576:12345-192.168.201.29@tcp:101:bash.0 Request processed in 22202us (22556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263328.166661:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:1.0:1788263328.169922:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263328.170005:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735912960 00000100:00100000:2.0:1788263328.170017:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735912960 00000100:00100000:2.0:1788263328.170080:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1788263328.170091:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+51:11472:x1875129735912960:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:2.0:1788263328.170392:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+52:11472:x1875129735912960:12345-192.168.201.29@tcp:35:bash.0 Request processed in 301us (481us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788263328.170400:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:3.0:1788263328.280720:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263328.280864:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735913216 00000100:00100000:0.0:1788263328.280876:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735913216 00000100:00100000:0.0:1788263328.280946:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00100000:0.0:1788263328.280957:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+52:11482:x1875129735913216:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263328.280985:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263328.281008:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395665f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d329d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263328.281114:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788263328.281273:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395665f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d329d expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.281289:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5f00) 00010000:00010000:0.0:1788263328.281292:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263328.281298:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395665f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d329d expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.281312:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658e00, rc 0) 00000100:00100000:0.0:1788263328.281381:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+53:11482:x1875129735913216:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 425us (673us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788263328.281418:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00100000:1.0:1788263328.287334:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263328.289314:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735913344 00000100:00100000:3.0:1788263328.289330:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735913344 00000100:00100000:3.0:1788263328.289404:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 164 00000100:00100000:3.0:1788263328.289415:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+53:11482:x1875129735913344:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1788263328.289498:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289516:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289530:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289572:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289580:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289587:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289688:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289699:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289706:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263328.289746:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289759:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289765:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289772:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289778:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263328.289782:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289797:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289810:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263328.289813:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263328.289818:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289825:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395666d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289838:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289844:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289850:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289855:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263328.289858:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289863:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289870:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994352cd3a00) 00010000:00010000:3.0:1788263328.289873:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263328.289875:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289890:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289906:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289911:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289917:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289921:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263328.289924:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289929:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289937:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263328.289939:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263328.289942:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.289947:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395667b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263328.290065:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+53:11482:x1875129735913344:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 649us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263328.290073:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 164 00000100:00100000:1.0:1788263328.299359:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263328.301539:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735913600 00000100:00100000:2.0:1788263328.301555:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735913600 00000100:00100000:2.0:1788263328.301635:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:2.0:1788263328.301657:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+53:11482:x1875129735913600:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263328.301924:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+54:11482:x1875129735913600:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 269us (2576us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788263328.301932:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:0.0:1788263328.382367:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263328.383785:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735913856 00000100:00100000:3.0:1788263328.383799:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735913856 00000100:00100000:3.0:1788263328.383926:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 165 00000100:00100000:3.0:1788263328.383938:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+54:11485:x1875129735913856:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263328.383968:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263328.383993:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32a4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384071:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384085:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384096:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384110:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384116:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384122:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384268:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956697 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384289:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384313:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263328.384324:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788263328.384438:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384446:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384453:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384459:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263328.384464:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384471:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384483:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263328.384486:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263328.384491:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384497:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956689 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384510:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384516:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384530:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384535:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263328.384538:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384545:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384552:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994352cd3a00) 00010000:00010000:3.0:1788263328.384555:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263328.384558:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384563:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513956690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384603:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513956682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32a4 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384618:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32a4 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.384625:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263328.384627:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263328.384630:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d800, rc 0) 00000100:00100000:3.0:1788263328.384759:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+56:11485:x1875129735913856:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 822us (2400us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788263328.384776:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 165 00000100:00100000:1.0:1788263328.390173:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263328.390299:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263328.390539:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735913984 00000100:00100000:2.0:1788263328.390654:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735914112 00000100:00100000:2.0:1788263328.390659:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735914112 00000100:00100000:3.0:1788263328.390660:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735913984 00000100:00100000:3.0:1788263328.390722:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:2.0:1788263328.390722:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788263328.390733:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+57:11485:x1875129735913984:12345-192.168.201.29@tcp:54:lfs.0 00000100:00100000:2.0:1788263328.390733:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+57:2361:x1875129735914112:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263328.390759:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263328.390785:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956697 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32a4 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.390796:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.390895:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.390908:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263328.392580:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:2.0:1788263328.392592:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263328.392745:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.392761:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.392768:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.392774:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263328.392779:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.392788:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.392802:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:3.0:1788263328.392820:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263328.392825:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.392832:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263328.392858:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+56:2361:x1875129735914112:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 2123us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263328.392868:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788263328.392874:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+56:11485:x1875129735913984:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 2144us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263328.392881:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:0.0:1788263328.400368:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263328.400449:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735914368 00000100:00100000:2.0:1788263328.400459:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735914368 00000100:00100000:2.0:1788263328.400518:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:2.0:1788263328.400528:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+55:11485:x1875129735914368:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263328.400862:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+56:11485:x1875129735914368:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 333us (503us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788263328.400886:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1788263328.507678:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753737600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263328.507755:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263328.507788:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753737600 00000100:00100000:3.0:1788263328.507799:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753737600 00000100:00100000:3.0:1788263328.507854:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788263328.507864:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753737600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263328.507907:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263328.508621:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753737600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263328.508671:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753737600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 806us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263328.508680:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788263328.529446:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263328.529601:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735914624 00000100:00100000:1.0:1788263328.529612:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735914624 00000100:00100000:1.0:1788263328.529679:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:1.0:1788263328.529690:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+56:11503:x1875129735914624:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:1.0:1788263328.529714:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263328.529735:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1600/0x1a657bc5139566ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32ab expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.529842:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0a00/0x1a657bc5139566b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.529857:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0a00/0x1a657bc5139566b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.529868:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0a00/0x1a657bc5139566b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263328.529880:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788263328.531776:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1600/0x1a657bc5139566ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ab expref: 59 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.531803:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0a00/0x1a657bc5139566b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ab expref: 58 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.531813:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:1.0:1788263328.531816:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788263328.531819:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0a00, rc 0) 00000100:00100000:1.0:1788263328.532438:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+58:11503:x1875129735914624:12345-192.168.201.29@tcp:101:cat.0 Request processed in 2209us (2461us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788263328.532448:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:0.0:1788263328.566803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263328.566882:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735914752 00000100:00100000:3.0:1788263328.566891:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735914752 00000100:00100000:3.0:1788263328.566946:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:3.0:1788263328.566956:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+58:11504:x1875129735914752:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263328.566981:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263328.567141:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.567210:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139566c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.567259:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139566c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.567271:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139566c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263328.567369:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788263328.567372:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263328.567390:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139566c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.567418:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b2 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.567439:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139566c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b2 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.567449:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263328.567452:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263328.567456:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ca00, rc 0) 00000100:00100000:3.0:1788263328.567530:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+59:11504:x1875129735914752:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 575us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263328.567537:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:2.0:1788263328.576109:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263328.576480:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735915136 00000100:00100000:3.0:1788263328.576493:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735915136 00000100:00100000:0.0:1788263328.576628:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:0.0:1788263328.576651:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+59:11504:x1875129735915136:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788263328.577064:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+60:11504:x1875129735915136:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 424us (967us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788263328.577073:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:3.0:1788263328.579037:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263328.579198:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735915264 00000100:00100000:1.0:1788263328.579208:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735915264 00000100:00100000:1.0:1788263328.579501:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788263328.579512:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+60:11504:x1875129735915264:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:1.0:1788263328.579530:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788263328.579582:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0c00/0x1a657bc513956658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3296 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.579603:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0a00/0x1a657bc5139566b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ab expref: 59 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.579614:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513956563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3257 expref: 58 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.579623:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9943565b5c00) 00010000:00010000:1.0:1788263328.579633:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263328.579701:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc92450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+57:11504:x1875129735915264:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 190us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263328.579709:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000001:00080000:1.0:1788263328.582030:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967451 is committed 00000004:00080000:1.0:1788263328.582053:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788263328.582180:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263328.582199:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994376152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753737728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788263328.582291:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263328.582353:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753737728 00000100:00100000:1.0:1788263328.582361:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753737728 00000100:00100000:1.0:1788263328.582408:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788263328.582417:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753737728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788263328.582443:0:8112:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1788263328.582476:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a96bb9e, atime: 0x6a96bb9e, ctime: 0x6a96bb9e, blocks: 0xb 00010000:00010000:1.0:1788263328.582483:0:8112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.582517:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1788263328.582521:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263328.582528:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.582555:0:8112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.582565:0:8112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.582573:0:8112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.582589:0:8112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788263328.583722:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263328.583890:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735915392 00000100:00100000:3.0:1788263328.583903:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735915392 00000100:00100000:3.0:1788263328.583943:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:3.0:1788263328.583952:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+53:11504:x1875129735915392:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:3.0:1788263328.584047:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.584060:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263328.584070:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263328.584420:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788263328.584500:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+53:11504:x1875129735915392:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 547us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263328.584508:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:1.0:1788263328.584999:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753737728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2582us (2706us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788263328.585008:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788263328.585029:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788263328.585043:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263328.585050:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.585061:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263328.585067:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.585089:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.585107:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.585115:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc5139566cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263328.585136:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263328.585138:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263328.585140:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788263328.585191:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:1.0:1788263328.585208:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788263328.585245:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99434f13f900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788263328.585250:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9943509c3600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99434f13f9c0 00000020:00080000:1.0:1788263328.585253:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9943509c3500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994346954800 00000020:00080000:1.0:1788263328.585277:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788263328.585384:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:0.0:1788263328.587525:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994376152a00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788263328.587653:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994376152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753737728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788263328.603685:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263328.603883:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735915520 00000100:00100000:0.0:1788263328.603893:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735915520 00000100:00100000:0.0:1788263328.603953:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 170 00000100:00100000:0.0:1788263328.603964:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+17:11506:x1875129735915520:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263328.603993:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263328.604016:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc5139566dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604081:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604096:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604119:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604133:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604140:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604146:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604467:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604475:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604482:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263328.604517:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788263328.604521:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263328.604551:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604562:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604570:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604586:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604593:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604599:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263328.604603:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604611:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604623:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263328.604626:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263328.604631:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604647:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc5139566e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604659:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604665:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604670:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604675:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263328.604683:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604689:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604696:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994344cab000) 00010000:00010000:0.0:1788263328.604699:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263328.604701:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604707:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139566eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604737:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc5139566dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b9 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604750:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b9 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263328.604757:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:0.0:1788263328.604759:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263328.604761:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659c00, rc 0) 00000100:00100000:0.0:1788263328.604831:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+18:11506:x1875129735915520:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 867us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263328.604838:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 170 00010000:00010000:1.0:1788263328.955497:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788263329.415537:0:12533:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263329.415547:0:12533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263329.415600:0:12533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788263329.415606:0:12533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788263329.474425:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263329.474435:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263329.477208:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788263329.479722:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263329.479980:0:11704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eec700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753737856:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788263329.480326:0:11704:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce300 going to sleep for 11 seconds 00000100:00100000:2.0:1788263329.503433:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.506988:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735915648 00000100:00100000:3.0:1788263329.507003:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735915648 00000100:00100000:3.0:1788263329.507089:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:3.0:1788263329.507100:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:11518:x1875129735915648:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788263329.507134:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788263329.507295:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:11518:x1875129735915648:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 196us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.507308:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:3.0:1788263329.511657:0:11704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eec700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753737856:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263329.522457:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.522651:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735915776 00000100:00100000:3.0:1788263329.522663:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735915776 00000100:00100000:3.0:1788263329.522733:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:3.0:1788263329.522745:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+18:11518:x1875129735915776:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788263329.522817:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522831:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522841:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522852:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522856:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522860:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522880:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522888:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522910:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263329.522948:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788263329.522951:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263329.522962:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522981:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522992:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.522998:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523004:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263329.523008:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523017:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523030:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:3.0:1788263329.523033:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263329.523038:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523044:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139566f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523075:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523080:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523084:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523087:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263329.523088:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523092:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523098:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff994352cd3700) 00010000:00010000:3.0:1788263329.523100:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263329.523103:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523109:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956700 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523126:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523132:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523138:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523149:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263329.523153:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523160:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523165:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:3.0:1788263329.523167:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263329.523169:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.523172:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263329.523262:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+18:11518:x1875129735915776:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 519us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.523279:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:1.0:1788263329.533835:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263329.533910:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735916032 00000100:00100000:2.0:1788263329.533922:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735916032 00000100:00100000:2.0:1788263329.533987:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:2.0:1788263329.533998:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+18:11518:x1875129735916032:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263329.534021:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263329.534046:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395670e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32c0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534155:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534170:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534182:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263329.534194:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788263329.534455:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534464:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534471:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534486:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263329.534492:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534500:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534514:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:2.0:1788263329.534517:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263329.534521:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534527:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534569:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395670e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32c0 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534580:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:2.0:1788263329.534582:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263329.534586:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395670e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32c0 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.534596:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263329.534742:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:11518:x1875129735916032:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 745us (914us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788263329.534750:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:0.0:1788263329.542396:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.545183:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735916160 00000100:00100000:3.0:1788263329.545198:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735916160 00000100:00100000:2.0:1788263329.545918:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 174 00000100:00100000:2.0:1788263329.545940:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+19:11518:x1875129735916160:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788263329.545976:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788263329.546091:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+19:11518:x1875129735916160:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 152us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263329.546099:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 174 00000100:00100000:2.0:1788263329.549403:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.549522:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735916416 00000100:00100000:3.0:1788263329.549534:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735916416 00000100:00100000:3.0:1788263329.549602:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 175 00000100:00100000:3.0:1788263329.549615:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:11518:x1875129735916416:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263329.549649:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263329.549652:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788263329.549683:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139566c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b2 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.549722:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263329.549726:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263329.549742:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956723 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32c7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263329.550510:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788263329.550784:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc51395672a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.550799:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc51395672a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.550813:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc51395672a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.550874:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956723 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32c7 expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.550895:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc51395672a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32c7 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.550903:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3700) 00010000:00010000:3.0:1788263329.550905:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263329.550908:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d200, rc 0) 00000100:00100000:3.0:1788263329.550995:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+20:11518:x1875129735916416:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1381us (1600us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788263329.551004:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 175 00000100:00100000:2.0:1788263329.555554:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263329.555704:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735916672 00000100:00100000:0.0:1788263329.555714:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735916672 00000100:00100000:0.0:1788263329.555774:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 176 00000100:00100000:0.0:1788263329.555787:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+20:11518:x1875129735916672:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788263329.555855:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263329.555885:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc51395672a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32c7 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.555903:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3700) 00010000:00010000:0.0:1788263329.555913:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263329.555936:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.555950:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.555960:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.555975:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.555983:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.555990:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556315:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556333:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556340:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556345:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263329.556350:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556357:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556366:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263329.556369:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263329.556373:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556378:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956738 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556388:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556394:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556399:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556404:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263329.556414:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556420:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556428:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x65121797 (ffff994344cab000) 00010000:00010000:0.0:1788263329.556431:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263329.556434:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.556440:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395673f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x65121797 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263329.556519:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+19:11518:x1875129735916672:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 733us (974us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263329.556527:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 176 00000100:00100000:1.0:1788263329.567710:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.567849:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735916800 00000100:00100000:3.0:1788263329.567859:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735916800 00000100:00100000:3.0:1788263329.567925:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:3.0:1788263329.567937:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:11518:x1875129735916800:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263329.567959:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263329.567986:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956746 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32ce expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.568024:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.568039:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.568052:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.568175:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ce expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.568193:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ce expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.568202:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:3.0:1788263329.568205:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263329.568209:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216cc00, rc 0) 00000100:00100000:3.0:1788263329.568295:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+20:11518:x1875129735916800:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 361us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.568302:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:1.0:1788263329.572529:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.572786:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735917056 00000100:00100000:3.0:1788263329.572800:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735917056 00000100:00100000:3.0:1788263329.572871:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 178 00000100:00100000:3.0:1788263329.572881:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+20:11518:x1875129735917056:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263329.572989:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.573007:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.573019:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263329.574293:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788263329.574310:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356362091194ns, next at 357362087501ns, rc = 0 00000004:00010000:3.0:1788263329.574428:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfff4196 reply state 000000001d72250a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263329.574440:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263329.574569:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+22:11518:x1875129735917056:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1686us (2050us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788263329.574579:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 178 00000100:00100000:3.0:1788263329.578936:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263329.579747:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735917184 00000100:00100000:2.0:1788263329.579761:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735917184 00000100:00100000:2.0:1788263329.579838:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 179 00000100:00100000:2.0:1788263329.579850:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+22:11518:x1875129735917184:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263329.579879:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263329.579901:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32d5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.579968:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32d5 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.579983:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32d5 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.580002:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:2.0:1788263329.580006:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263329.580009:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263329.580727:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+23:11518:x1875129735917184:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 230us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263329.580750:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 179 00010000:00010000:1.0:1788263329.581798:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.581822:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.581829:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.581835:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263329.581840:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.581848:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.581866:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:1.0:1788263329.581869:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788263329.581873:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.581880:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956754 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263329.588531:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263329.588655:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735917312 00000100:00100000:1.0:1788263329.588665:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735917312 00000100:00100000:1.0:1788263329.588741:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:1.0:1788263329.588753:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735917312:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788263329.589342:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735917312:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 589us (828us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788263329.589351:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00080000:0.0:1788263329.589758:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263329.591593:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263329.591742:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735917568 00000100:00100000:2.0:1788263329.591752:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735917568 00000100:00100000:2.0:1788263329.591808:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:2.0:1788263329.591818:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+22:11518:x1875129735917568:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788263329.592069:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+23:11518:x1875129735917568:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 252us (485us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788263329.592078:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1788263329.594898:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263329.594999:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735917824 00000100:00100000:1.0:1788263329.595009:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735917824 00000100:00100000:1.0:1788263329.595068:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 180 00000100:00100000:1.0:1788263329.595079:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+23:11518:x1875129735917824:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788263329.595204:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+23:11518:x1875129735917824:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 126us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263329.595213:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 180 00000100:00100000:0.0:1788263329.598447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.598540:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735917952 00000100:00100000:3.0:1788263329.598550:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735917952 00000100:00100000:3.0:1788263329.598608:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 181 00000100:00100000:3.0:1788263329.598633:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+23:11518:x1875129735917952:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263329.598657:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263329.598689:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956762 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32dc expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.598769:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.598783:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.598795:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263329.598833:0:6725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263329.598853:0:6725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.598883:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956762 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32dc expref: 25 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.598902:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32dc expref: 24 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.598911:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:3.0:1788263329.598914:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788263329.598918:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d000, rc 0) 00000100:00100000:3.0:1788263329.598990:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+24:11518:x1875129735917952:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 372us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.598998:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 181 00000100:00100000:2.0:1788263329.602928:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.602983:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735918080 00000100:00100000:3.0:1788263329.602994:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735918080 00000100:00100000:3.0:1788263329.603143:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:3.0:1788263329.603153:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735918080:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263329.603172:0:8112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263329.603192:0:8112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32e3 expref: -99 pid: 8112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263329.603245:0:8112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bba1, blocks: 0x1 00010000:00010000:3.0:1788263329.603265:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1788263329.603270:0:8112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263329.603281:0:8112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32e3 expref: 8 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.603303:0:8112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32e3 expref: 8 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.603317:0:8112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ca00, rc 0) 00000100:00100000:3.0:1788263329.603382:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735918080:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 229us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.603390:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:0.0:1788263329.615318:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263329.615749:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735918336 00000100:00100000:1.0:1788263329.615760:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735918336 00000100:00100000:1.0:1788263329.615829:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 182 00000100:00100000:1.0:1788263329.615841:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+24:11518:x1875129735918336:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788263329.615967:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+24:11518:x1875129735918336:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 126us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263329.615976:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 182 00000100:00100000:2.0:1788263329.623426:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263329.623513:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735918464 00000100:00100000:1.0:1788263329.623524:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735918464 00000100:00100000:1.0:1788263329.623603:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:1.0:1788263329.623628:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+8:11518:x1875129735918464:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263329.623650:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263329.623671:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32ea expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.623709:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32e3 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.623719:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263329.623732:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263329.623738:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.623781:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32e3 expref: 9 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.623795:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32e3 expref: 9 pid: 8112 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263329.623812:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994376150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1875129753737984:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263329.623918:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263329.643019:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.643184:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735918592 00000100:00100000:3.0:1788263329.643196:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735918592 00010000:00010000:3.0:1788263329.643288:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32e3 expref: 10 pid: 8112 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263329.643327:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1788263329.643339:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+10:2362:x1875129735918592:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263329.643363:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263329.643387:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32e3 expref: 10 pid: 8112 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.643402:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32e3 expref: 10 pid: 8112 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.643429:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263329.643434:0:8470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263329.643442:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.643452:0:8470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.643490:0:8470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263329.643505:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8470:1875129753738112:192.168.201.29@tcp:105: 00000100:00100000:3.0:1788263329.643599:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce300 going to sleep for 11 seconds 00000100:00100000:3.0:1788263329.650787:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8470:1875129753738112:192.168.201.29@tcp:105: 00010000:00010000:3.0:1788263329.650813:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263329.650874:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+10:2362:x1875129735918592:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 7537us (7865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.650885:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00010000:00010000:0.0:1788263329.651308:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5bc92a0/0x1a657bc513956770 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32e3 expref: 9 pid: 8112 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263329.651325:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994376150700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1875129753737984:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263329.651347:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.651362:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0000, rc 0) 00000100:00100000:0.0:1788263329.651396:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+8:11518:x1875129735918464:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 27783us (27981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.651402:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:3.0:1788263329.666716:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263329.666863:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735918720 00000100:00100000:2.0:1788263329.666873:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735918720 00002000:00100000:2.0:1788263329.666926:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff994380eedc00 x1875129735918720/t0(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:540/0 lens 504/0 e 0 to 0 dl 1788263340 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263329.666938:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994380eedc00 with x1875129735918720 ext(0->8) 00002000:00010000:2.0:1788263329.666945:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994380eedc00 00000100:00100000:2.0:1788263329.667008:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788263329.667018:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735918720:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788263329.667559:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fedef325-db54-4469-b29a-301ff58466df+10:2362:x1875129735918720:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 539us (851us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788263329.667568:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00002000:00100000:2.0:1788263329.667575:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff994380eedc00 x1875129735918720/t4294967314(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:540/0 lens 504/448 e 0 to 0 dl 1788263340 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263329.667596:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994380eedc00 with x1875129735918720 ext(0->8) 00002000:00010000:2.0:1788263329.667600:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994380eedc00 00000100:00100000:1.0:1788263329.672790:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.672866:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735918848 00000100:00100000:3.0:1788263329.672877:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735918848 00000100:00100000:3.0:1788263329.672930:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 183 00000100:00100000:3.0:1788263329.672940:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+24:11518:x1875129735918848:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788263329.704169:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+24:11518:x1875129735918848:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 31218us (31377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263329.704185:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 183 00000001:00080000:1.0:1788263329.704249:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:1.0:1788263329.704261:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1788263329.704276:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1788263329.704287:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788263329.704407:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788263329.704420:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788263329.704534:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994376151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753738240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788263329.704588:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263329.704675:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753738240 00000100:00100000:1.0:1788263329.704682:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753738240 00000100:00100000:1.0:1788263329.704740:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788263329.704748:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753738240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788263329.704886:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788263329.704889:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788263329 00002000:00010000:1.0:1788263329.704892:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788263329.704894:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788263329 -> 1788263329 00002000:00010000:1.0:1788263329.704896:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788263329.704926:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875129753738240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (338us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788263329.704932:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788263329.704947:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788263329.704976:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994376151500/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788263329.704981:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994376151500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753738240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788263329.712933:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263329.713034:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735918976 00000100:00100000:2.0:1788263329.713043:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735918976 00000100:00100000:2.0:1788263329.713104:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1788263329.713115:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+10:2361:x1875129735918976:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788263329.759407:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1788263329.759423:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1788263329.759433:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1788263329.759705:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376153480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735918976:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 46586us (46777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263329.759717:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:1.0:1788263329.767087:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263329.770724:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735919232 00000100:00100000:2.0:1788263329.770742:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735919232 00000100:00100000:2.0:1788263329.770811:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 184 00000100:00100000:2.0:1788263329.770822:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+18:11518:x1875129735919232:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788263329.770883:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263329.770914:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32dc expref: 18 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.770940:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:2.0:1788263329.770945:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263329.770976:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.770989:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.770999:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263329.773598:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd5f7c3e reply state 000000005d754a4f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263329.773623:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263329.773755:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376153b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+19:11518:x1875129735919232:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 2932us (6678us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788263329.773762:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 184 00010000:00010000:3.0:1788263329.777072:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.777090:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.777098:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.777104:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263329.777109:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.777115:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.777134:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:3.0:1788263329.777138:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263329.777142:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.777148:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395677e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263329.778821:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263329.778916:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735919360 00000100:00100000:0.0:1788263329.778927:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735919360 00000100:00100000:0.0:1788263329.778994:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:0.0:1788263329.779008:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735919360:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788263329.779319:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788263329.779323:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788263329 -> 1788263327 00002000:00010000:0.0:1788263329.779326:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788263326 00002000:00010000:0.0:1788263329.779328:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788263329 -> 1788263327 00002000:00010000:0.0:1788263329.779331:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788263329.779489:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376153100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735919360:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 483us (677us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788263329.779498:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1788263329.786857:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.792198:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735919616 00000100:00100000:3.0:1788263329.792214:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735919616 00000100:00100000:3.0:1788263329.792328:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 185 00000100:00100000:3.0:1788263329.792340:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+18:11518:x1875129735919616:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788263329.792417:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.792437:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ce expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.792447:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.792485:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ce expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.792501:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ce expref: 18 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263329.792516:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753738368:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263329.792647:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce240 going to sleep for 11 seconds 00000100:00100000:3.0:1788263329.799432:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eed180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753738368:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263329.799466:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263329.800535:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.800611:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735919744 00000100:00100000:3.0:1788263329.800627:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735919744 00010000:00010000:3.0:1788263329.800667:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ce expref: 19 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263329.800710:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:3.0:1788263329.800733:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+19:2362:x1875129735919744:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263329.800748:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263329.800755:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ce expref: 19 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.800767:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ce expref: 19 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.800790:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc51395674d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ce expref: 19 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.800805:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:3.0:1788263329.800810:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.800819:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.800826:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.800854:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263329.800957:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+18:2362:x1875129735919744:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 225us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.800966:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00010000:00010000:2.0:1788263329.801064:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.801071:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.801098:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.801104:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.801110:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.801116:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263329.801120:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.801127:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.801136:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:2.0:1788263329.801139:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788263329.801143:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.801148:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956785 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263329.801197:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+17:11518:x1875129735919616:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 8860us (14354us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788263329.801205:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 185 00000100:00100000:2.0:1788263329.804660:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263329.804750:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735919872 00000100:00100000:0.0:1788263329.804762:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735919872 00000100:00100000:0.0:1788263329.804821:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1788263329.804831:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+8:2361:x1875129735919872:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788263329.804877:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.804910:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.804918:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263329.804923:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263329.804928:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.804964:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263329.804978:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 8 pid: 6704 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263329.804993:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1875129753738496:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263329.805090:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263329.806858:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1875129753738496:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263329.806885:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263329.808214:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263329.808466:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735920000 00000100:00100000:1.0:1788263329.808476:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735920000 00010000:00010000:1.0:1788263329.808518:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 9 pid: 6704 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263329.808578:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:1.0:1788263329.808589:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+9:2361:x1875129735920000:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263329.808606:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263329.808641:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 9 pid: 6704 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.808656:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 9 pid: 6704 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.808682:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6bb1cba/0x1a657bc513956777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ea expref: 9 pid: 6704 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.808700:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263329.808705:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263329.808711:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.808720:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.808761:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263329.808936:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+8:2361:x1875129735920000:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 347us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263329.808943:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00010000:00010000:3.0:1788263329.809010:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.809019:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.809053:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.809061:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.809068:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.809074:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263329.809079:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.809087:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.809099:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.809105:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc51395678c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263329.809150:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735919872:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 4321us (4503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.809157:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1788263329.836153:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.836249:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735920256 00000100:00100000:3.0:1788263329.836260:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735920256 00000100:00100000:3.0:1788263329.836376:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 186 00000100:00100000:3.0:1788263329.836387:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+17:11518:x1875129735920256:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788263329.836671:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.836691:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.836703:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.836916:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.836929:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32d5 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.836937:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.836976:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32d5 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.836989:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32d5 expref: 18 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263329.837020:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753738624:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263329.837112:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263329.842984:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753738624:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263329.843020:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263329.847648:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263329.847943:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735920384 00000100:00100000:3.0:1788263329.847954:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735920384 00010000:00010000:3.0:1788263329.848011:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32d5 expref: 19 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263329.848057:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:3.0:1788263329.848079:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+19:2362:x1875129735920384:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263329.848093:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263329.848101:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32d5 expref: 19 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.848114:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32d5 expref: 19 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.848135:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc51395675b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32d5 expref: 19 pid: 5853 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.848150:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:3.0:1788263329.848155:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.848163:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.848188:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263329.848256:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263329.848453:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+18:2362:x1875129735920384:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 250us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.848461:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00010000:00010000:1.0:1788263329.849642:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.849656:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263329.849854:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788263329.849998:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788263329.850040:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788263329.850127:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994376153800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5854:1875129753738752:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788263329.850193:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263329.850240:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263329.852388:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753738752 00000100:00100000:3.0:1788263329.852404:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753738752 00000100:00100000:3.0:1788263329.852473:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263329.852485:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1875129753738752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788263329.852636:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1875129753738752:12345-0@lo:1000:mdt00_002.0 Request processed in 153us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.852645:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263329.852677:0:5854:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788263329.852684:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994376151500, transno 4294967315 00000100:00100000:2.0:1788263329.852700:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994376153800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5854:1875129753738752:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788263329.853415:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788263329.853501:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5854:1875129753738880:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788263329.853633:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263329.853670:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263329.853859:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753738880 00000100:00100000:0.0:1788263329.853865:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753738880 00000100:00100000:0.0:1788263329.853911:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788263329.853928:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1875129753738880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788263329.854119:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5854:x1875129753738880:12345-0@lo:1000:mdt00_002.0 Request processed in 192us (486us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788263329.854126:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263329.854253:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5854:1875129753738880:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788263329.854396:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854408:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854416:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854423:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263329.854428:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854436:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854452:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff994352cd3f00) 00010000:00010000:2.0:1788263329.854463:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263329.854468:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854474:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc51395679a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854507:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854514:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854594:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854599:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263329.854603:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854610:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854628:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:2.0:1788263329.854631:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263329.854634:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854639:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139566d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854662:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854687:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b9 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854695:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854722:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b9 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.854736:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b9 expref: 21 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263329.854748:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a589180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753739008:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263329.854822:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263329.863130:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263329.863245:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735920512 00000100:00100000:1.0:1788263329.863255:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735920512 00010000:00010000:1.0:1788263329.863306:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b9 expref: 22 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263329.863338:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:1.0:1788263329.863349:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+22:2361:x1875129735920512:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263329.863365:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263329.863372:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b9 expref: 22 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.863392:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b9 expref: 22 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.863416:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:1.0:1788263329.863422:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.863449:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.863457:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.863479:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263329.863542:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+22:2361:x1875129735920512:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 194us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263329.863549:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00010000:00010000:2.0:1788263329.864754:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139566f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32b9 expref: 21 pid: 5854 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263329.864775:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a589180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753739008:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263329.864800:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864810:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864816:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864828:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864846:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864852:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864858:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263329.864863:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864870:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864883:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:2.0:1788263329.864886:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263329.864889:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864895:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864906:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864912:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864917:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864922:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263329.864931:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864938:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864946:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3c00) 00010000:00010000:2.0:1788263329.864948:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788263329.864950:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.864955:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc513956793 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263329.865701:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+20:11518:x1875129735920256:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 29311us (29560us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788263329.865712:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 186 00000020:00080000:2.0:1788263329.865718:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788263329.872505:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263329.872516:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263329.873039:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788263329.873052:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263329.873475:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263329.873573:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735920768 00000100:00100000:2.0:1788263329.873582:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735920768 00000100:00100000:2.0:1788263329.873635:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1788263329.873645:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2c8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+20:11518:x1875129735920768:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788263329.874471:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788263329.874573:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788263329.874632:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.874661:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.874673:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.874682:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.874688:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.874693:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.874756:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788263329.874850:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2c8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+22:11518:x1875129735920768:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1204us (1377us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788263329.874859:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000020:00080000:2.0:1788263329.874865:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788263329.879447:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263329.879463:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.879476:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263329.879482:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.879492:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.879513:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99434314fb00) 00010000:00010000:1.0:1788263329.879516:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263329.879520:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.879527:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263329.879548:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263329.879567:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263329.879569:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263329.983029:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263330.023176:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263330.023267:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263330.023311:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263330.023412:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735920896 00000100:00100000:2.0:1788263330.023423:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735920896 00000100:00100000:2.0:1788263330.023480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 288 00000100:00100000:2.0:1788263330.023488:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735920896:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263330.023569:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735920896:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 80us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263330.023577:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 288 00000100:00100000:1.0:1788263330.023852:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735921024 00000100:00100000:1.0:1788263330.023857:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735921024 00000100:00100000:3.0:1788263330.023969:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735921152 00000100:00100000:1.0:1788263330.024139:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:1.0:1788263330.024147:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735921024:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263330.024181:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735921024:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 35us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263330.024188:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:3.0:1788263330.024276:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735921152 00000100:00080000:0.0:1788263330.025729:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263330.025739:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263330.028120:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 138 00000100:00100000:3.0:1788263330.028140:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735921152:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263330.028265:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735921152:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 131us (4952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263330.028273:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 138 00010000:00010000:3.0:1788263331.006974:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788263331.249172:0:12584:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263331.249191:0:12584:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263331.249252:0:12584:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788263331.249257:0:12584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788263331.395898:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263331.395982:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735921408 00000100:00100000:3.0:1788263331.395992:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735921408 00000100:00100000:3.0:1788263331.396059:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 187 00000100:00100000:3.0:1788263331.396069:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+22:11535:x1875129735921408:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263331.396099:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263331.396119:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139567af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32f1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.396213:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139567b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.396249:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139567b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.396264:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139567b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263331.396275:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788263331.396390:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139567af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f1 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.396407:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139567b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f1 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.396416:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263331.396419:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788263331.396423:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216cc00, rc 0) 00000100:00100000:3.0:1788263331.396483:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+24:11535:x1875129735921408:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 414us (593us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788263331.396491:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 187 00000100:00080000:2.0:1788263331.396677:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263331.401109:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263331.401189:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735921536 00000100:00100000:2.0:1788263331.401199:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735921536 00000100:00100000:2.0:1788263331.401273:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 188 00000100:00100000:2.0:1788263331.401284:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+24:11535:x1875129735921536:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:2.0:1788263331.401359:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401377:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401388:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401402:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401409:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401415:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401652:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401661:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401669:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263331.401708:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401726:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401732:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401739:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401746:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263331.401750:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401758:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401770:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:2.0:1788263331.401773:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263331.401777:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401785:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc5139567c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401797:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401804:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401811:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401821:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263331.401825:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401831:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401839:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99434314f500) 00010000:00010000:2.0:1788263331.401841:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263331.401844:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401850:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139567cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401862:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401868:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401875:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401881:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263331.401884:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401890:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401906:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99434314fd00) 00010000:00010000:2.0:1788263331.401909:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263331.401912:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.401918:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139567d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263331.401992:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+24:11535:x1875129735921536:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 709us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263331.402001:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 188 00000100:00100000:0.0:1788263331.442042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263331.442170:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735921792 00000100:00100000:3.0:1788263331.442180:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735921792 00000100:00100000:3.0:1788263331.442265:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 189 00000100:00100000:3.0:1788263331.442276:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+24:11538:x1875129735921792:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263331.442296:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263331.442316:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139567d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442389:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442403:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442414:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442429:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442436:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442442:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442696:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442704:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442712:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263331.442730:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788263331.442818:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442825:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442831:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442837:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263331.442841:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442848:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442860:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263331.442863:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263331.442867:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442873:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc5139567e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442884:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442890:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442905:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442911:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263331.442914:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442920:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442927:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994352cd3d00) 00010000:00010000:3.0:1788263331.442930:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263331.442933:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.442939:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139567e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.443388:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139567d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f8 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.443405:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f8 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.443413:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:3.0:1788263331.443415:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263331.443418:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d800, rc 0) 00000100:00100000:3.0:1788263331.446663:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+26:11538:x1875129735921792:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 4376us (4616us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788263331.446686:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 189 00000100:00100000:3.0:1788263331.457480:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.459292:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735921920 00000100:00100000:0.0:1788263331.459305:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735921920 00000100:00100000:0.0:1788263331.459363:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:0.0:1788263331.459373:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+26:11538:x1875129735921920:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1788263331.459444:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.459462:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.459475:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.459502:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.459517:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.459523:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.459530:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263331.459534:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.459541:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.459553:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:0.0:1788263331.459556:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263331.459560:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.459566:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139567fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263331.459655:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+26:11538:x1875129735921920:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 283us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263331.459663:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:1.0:1788263331.465627:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.472276:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735922176 00000100:00100000:0.0:1788263331.472292:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735922176 00000100:00100000:0.0:1788263331.472351:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:0.0:1788263331.472364:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+26:11538:x1875129735922176:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788263331.472626:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+27:11538:x1875129735922176:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 264us (7006us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788263331.472647:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:0.0:1788263331.507704:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263331.507909:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735922432 00000100:00100000:3.0:1788263331.507920:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735922432 00000100:00100000:3.0:1788263331.507976:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 191 00000100:00100000:3.0:1788263331.507988:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+27:11065:x1875129735922432:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788263331.508015:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263331.508036:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956803 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d32ff expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.508149:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.508164:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f8 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.508173:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.508210:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f8 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.508369:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f8 expref: 28 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263331.508384:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753739136:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263331.517175:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263331.523738:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263331.523930:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735922560 00000100:00100000:3.0:1788263331.523953:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735922560 00010000:00010000:3.0:1788263331.524050:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f8 expref: 29 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263331.524127:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:3.0:1788263331.524139:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+29:2362:x1875129735922560:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263331.524155:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263331.524162:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f8 expref: 29 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.524175:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f8 expref: 29 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.524198:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:3.0:1788263331.524202:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.524212:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.524259:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.524276:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263331.524282:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc5139567ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f8 expref: 29 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263331.524300:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eed880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1875129753739136:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263331.524322:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263331.524325:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+28:2362:x1875129735922560:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 190us (598us total) trans 0 rc 0/0 00010000:00010000:1.0:1788263331.524331:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263331.524333:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00010000:00010000:1.0:1788263331.524337:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263331.524356:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788263331.524506:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956803 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ff expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.524534:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ff expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.524543:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:1.0:1788263331.524546:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788263331.524549:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ca00, rc 0) 00000100:00100000:1.0:1788263331.524574:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+28:11065:x1875129735922432:12345-192.168.201.29@tcp:101:bash.0 Request processed in 16589us (16880us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788263331.524581:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 191 00000100:00100000:3.0:1788263331.526528:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.526665:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735922816 00000100:00100000:0.0:1788263331.526674:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735922816 00000100:00100000:0.0:1788263331.526730:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 192 00000100:00100000:0.0:1788263331.526740:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+28:11065:x1875129735922816:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:0.0:1788263331.527014:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.527030:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.527040:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788263331.527085:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788263331.527108:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a1e9c14 reply state 00000000b31a7939 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263331.527117:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788263331.527159:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788263331.527285:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+32:11065:x1875129735922816:12345-192.168.201.29@tcp:36:bash.0 Request processed in 546us (764us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788263331.527292:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 192 00000020:00080000:0.0:1788263331.527297:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788263331.529253:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:1.0:1788263331.529574:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.529597:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.529611:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.529618:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263331.529623:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.529631:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.529649:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:1.0:1788263331.529653:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263331.529657:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.529674:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956818 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263331.531258:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735922944 00000100:00100000:2.0:1788263331.531272:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735922944 00000100:00100000:2.0:1788263331.531334:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 193 00000100:00100000:2.0:1788263331.531345:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+31:11065:x1875129735922944:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263331.531370:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263331.531393:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc51395681f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3306 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.531460:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc51395681f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3306 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.531476:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc51395681f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3306 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.531692:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:2.0:1788263331.531696:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263331.531710:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6200, rc 0) 00000100:00100000:2.0:1788263331.531806:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+32:11065:x1875129735922944:12345-192.168.201.29@tcp:101:bash.0 Request processed in 462us (2562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263331.531814:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 193 00000100:00100000:3.0:1788263331.533932:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263331.534056:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735923072 00000100:00100000:2.0:1788263331.534064:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735923072 00000100:00100000:2.0:1788263331.534170:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:2.0:1788263331.534180:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+7:11065:x1875129735923072:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263331.534199:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263331.534254:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d330d expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263331.534281:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a96bb9f, atime: 0x6a96bb9e, ctime: 0x6a96bb9f, blocks: 0xb 00010000:00010000:2.0:1788263331.534301:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788263331.534306:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263331.534314:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d330d expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.534333:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d330d expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.534346:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7600, rc 0) 00000100:00100000:2.0:1788263331.534400:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+8:11065:x1875129735923072:12345-192.168.201.29@tcp:101:bash.0 Request processed in 221us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263331.534407:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00080000:0.0:1788263331.534615:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263331.537883:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.537953:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735923200 00000100:00100000:0.0:1788263331.537979:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735923200 00002000:00010000:0.0:1788263331.538027:0:6708:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788263331.538032:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994376152300 with x1875129735923200 ext(0->18446744073709551615) 00002000:00010000:0.0:1788263331.538044:0:6708:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994376152300. 00000100:00100000:0.0:1788263331.538079:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:0.0:1788263331.538089:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+8:2360:x1875129735923200:12345-192.168.201.29@tcp:10:bash.0 00002000:00010000:0.0:1788263331.538451:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788263331.538455:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788263327 -> 1788263331 00002000:00010000:0.0:1788263331.538458:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788263326 -> 1788263326 00002000:00010000:0.0:1788263331.538460:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788263327 -> 1788263331 00002000:00010000:0.0:1788263331.538462:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788263331.539016:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fedef325-db54-4469-b29a-301ff58466df+9:2360:x1875129735923200:12345-192.168.201.29@tcp:10:bash.0 Request processed in 925us (1141us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788263331.539026:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00002000:00010000:0.0:1788263331.539030:0:6708:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788263331.539033:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994376152300 with x1875129735923200 ext(0->18446744073709551615) 00002000:00010000:0.0:1788263331.539039:0:6708:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994376152300. 00000100:00100000:0.0:1788263331.596006:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263331.596177:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735923328 00000100:00100000:2.0:1788263331.596202:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735923328 00000100:00100000:2.0:1788263331.596301:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:2.0:1788263331.596313:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+32:11552:x1875129735923328:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1788263331.596578:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.596687:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.596700:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.596717:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.596725:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.596732:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.596940:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.596947:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.596952:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263331.597056:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597065:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597069:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597079:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597083:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263331.597086:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597090:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597099:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263331.597101:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263331.597104:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597108:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc51395682d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597118:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597122:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597125:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597128:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263331.597129:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597139:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597144:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994352cd3d00) 00010000:00010000:3.0:1788263331.597145:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263331.597147:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597150:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc513956834 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597158:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597161:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597164:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597167:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263331.597168:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597172:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597176:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:3.0:1788263331.597177:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263331.597178:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.597187:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395683b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263331.597291:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+32:11552:x1875129735923328:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 979us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263331.597299:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:1.0:1788263331.628309:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.628470:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735923584 00000100:00100000:0.0:1788263331.628480:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735923584 00000100:00100000:0.0:1788263331.628550:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 195 00000100:00100000:0.0:1788263331.628561:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+32:11555:x1875129735923584:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263331.628593:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263331.628617:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956842 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3314 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.628717:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.628731:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.628743:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.628759:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.628766:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.628771:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629402:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956857 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629415:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629423:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263331.629435:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788263331.629553:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629561:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629575:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629581:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263331.629596:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629605:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629618:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263331.629622:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263331.629626:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629633:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956849 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629645:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629651:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629657:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629662:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263331.629665:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629681:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629689:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994344cab000) 00010000:00010000:0.0:1788263331.629691:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263331.629693:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629698:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629740:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3314 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629753:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3314 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.629760:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:0.0:1788263331.629761:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788263331.629763:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658e00, rc 0) 00000100:00100000:0.0:1788263331.632611:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+34:11555:x1875129735923584:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1288us (1550us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788263331.632633:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 195 00000100:00100000:1.0:1788263331.634883:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263331.634974:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735923712 00000100:00100000:3.0:1788263331.634984:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735923712 00000100:00100000:3.0:1788263331.635043:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:3.0:1788263331.635054:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+34:11555:x1875129735923712:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:3.0:1788263331.635125:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.635144:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ff expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.635154:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.635193:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ff expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.635206:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ff expref: 34 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263331.635260:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380eeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753739264:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263331.635352:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263331.643122:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.643687:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735923968 00000100:00100000:0.0:1788263331.643698:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735923968 00000100:00100000:0.0:1788263331.643761:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:0.0:1788263331.643772:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+35:6059:x1875129735923968:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788263331.644141:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+36:6059:x1875129735923968:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 369us (1030us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788263331.644150:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:3.0:1788263331.646921:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380eeea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753739264:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263331.646953:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263331.659136:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263331.659264:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735924096 00000100:00100000:2.0:1788263331.659275:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735924096 00010000:00010000:2.0:1788263331.659319:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ff expref: 36 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263331.659362:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:2.0:1788263331.659373:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+36:2361:x1875129735924096:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263331.659388:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263331.659395:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ff expref: 36 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.659409:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ff expref: 36 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.659435:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc51395680a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32ff expref: 36 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.659454:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:2.0:1788263331.659459:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.659468:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.659511:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.659545:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263331.659613:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+35:2361:x1875129735924096:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 242us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263331.659621:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00010000:00010000:3.0:1788263331.659795:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.659805:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.659835:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.659842:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.659849:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.659855:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216de00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263331.659859:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.659866:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.659877:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:3.0:1788263331.659879:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263331.659882:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.659887:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263331.659937:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+34:11555:x1875129735923712:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 24884us (25063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263331.659945:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:1.0:1788263331.662436:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.662543:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735924352 00000100:00100000:0.0:1788263331.662552:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735924352 00000100:00100000:0.0:1788263331.662612:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:0.0:1788263331.662623:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+34:11555:x1875129735924352:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788263331.662870:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+35:11555:x1875129735924352:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 247us (441us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788263331.662878:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:0.0:1788263331.802014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263331.802121:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735924608 00000100:00100000:2.0:1788263331.802130:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735924608 00000100:00100000:2.0:1788263331.802190:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 197 00000100:00100000:2.0:1788263331.802201:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+35:11566:x1875129735924608:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:2.0:1788263331.802270:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263331.802293:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395686c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d331b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802383:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802398:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802410:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802425:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802432:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802457:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802875:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802886:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802894:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263331.802903:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788263331.802991:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.802998:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803005:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803011:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263331.803015:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803023:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803034:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:2.0:1788263331.803037:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263331.803046:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803052:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc513956873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803064:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803070:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803075:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803080:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263331.803083:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803089:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803096:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99434314ff00) 00010000:00010000:2.0:1788263331.803098:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263331.803101:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803106:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395687a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803144:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc51395686c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d331b expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803168:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d331b expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.803176:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:2.0:1788263331.803178:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263331.803181:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263331.803286:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+37:11566:x1875129735924608:12345-192.168.201.29@tcp:101:cat.0 Request processed in 1086us (1281us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788263331.803294:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 197 00000100:00100000:1.0:1788263331.813453:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.813571:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735924864 00000100:00100000:0.0:1788263331.813590:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735924864 00000100:00100000:0.0:1788263331.813652:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:0.0:1788263331.813663:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+37:11566:x1875129735924864:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:0.0:1788263331.813902:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+38:11566:x1875129735924864:12345-192.168.201.29@tcp:35:cat.0 Request processed in 240us (458us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788263331.813910:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:3.0:1788263331.841076:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.844750:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735925120 00000100:00100000:0.0:1788263331.844765:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735925120 00000100:00100000:0.0:1788263331.844837:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 198 00000100:00100000:0.0:1788263331.844844:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+38:11567:x1875129735925120:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:0.0:1788263331.844896:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788263331.844921:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d331b expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.844957:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3314 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.844965:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc51395681f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3306 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.844971:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994352cd3e00) 00010000:00010000:0.0:1788263331.844979:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263331.844995:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845004:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845010:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845019:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845023:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845027:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845213:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845234:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845244:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263331.845753:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788263331.845761:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358633542807ns, next at 359633541095ns, rc = 0 00010000:00010000:0.0:1788263331.845804:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845811:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845817:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845822:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845826:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845830:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845852:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263331.845866:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845870:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845873:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845882:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263331.845885:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845890:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845896:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994344cabe00) 00010000:00010000:0.0:1788263331.845898:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788263331.845901:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845904:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc51395689d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845915:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845918:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845921:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845924:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263331.845926:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845929:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845939:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263331.845940:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263331.845942:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.845945:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395688f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263331.845950:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000236364f9 reply state 00000000a5659411 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263331.845956:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788263331.845991:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263331.846000:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.846008:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263331.846012:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.846019:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.846030:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff994344cabe00) 00010000:00010000:1.0:1788263331.846033:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263331.846036:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.846042:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139568a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.846055:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263331.846057:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263331.846065:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263331.846499:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+37:11567:x1875129735925120:12345-192.168.201.29@tcp:36:rm.0 Request processed in 1650us (5429us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788263331.846507:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 198 00010000:00010000:3.0:1788263331.853625:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.853645:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.853654:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.853661:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263331.853666:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.853675:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.853693:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994344cab000) 00010000:00010000:3.0:1788263331.853696:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263331.853700:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.853707:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956896 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263331.936630:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263331.940187:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735925376 00000100:00100000:2.0:1788263331.940201:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735925376 00000100:00100000:2.0:1788263331.940283:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 199 00000100:00100000:2.0:1788263331.940294:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+36:11573:x1875129735925376:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263331.940320:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263331.940341:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139568ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3322 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.940666:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.940681:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.940693:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.940709:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.940729:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.940735:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788263331.941210:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788263331.942700:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942719:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942728:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942765:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942774:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942781:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942787:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263331.942792:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942799:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942827:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:2.0:1788263331.942830:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263331.942835:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942841:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139568b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263331.942857:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3db7b9e reply state 0000000019495ca4 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263331.942866:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788263331.942901:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc5139568ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3322 expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942919:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3322 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.942927:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99434314fb00) 00010000:00010000:2.0:1788263331.942929:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263331.942932:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263331.943017:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+39:11573:x1875129735925376:12345-192.168.201.29@tcp:101:bash.0 Request processed in 2725us (6395us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788263331.943027:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 199 00010000:00010000:3.0:1788263331.949666:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.949702:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.949709:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.949715:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263331.949720:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.949727:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.949745:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99434314ff00) 00010000:00010000:3.0:1788263331.949748:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263331.949752:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263331.949759:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139568b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263331.951344:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263331.953673:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735925504 00000100:00100000:1.0:1788263331.953689:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735925504 00000100:00100000:1.0:1788263331.953766:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:1.0:1788263331.953779:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2359:x1875129735925504:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263331.953799:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263331.953822:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3329 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263331.953851:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263331.953871:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1788263331.953876:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263331.953886:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3329 expref: 6 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.953908:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3329 expref: 6 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263331.953925:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0e00, rc 0) 00000100:00100000:1.0:1788263331.954014:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735925504:12345-192.168.201.29@tcp:101:bash.0 Request processed in 236us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263331.954022:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:1.0:1788263331.958788:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263331.958885:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735925632 00000100:00100000:2.0:1788263331.958894:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735925632 00000100:00100000:2.0:1788263331.958977:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:2.0:1788263331.958988:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+6:11573:x1875129735925632:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263331.959016:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263331.959034:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3330 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.959075:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3329 expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.959084:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263331.959088:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263331.959093:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.959127:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3329 expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.959141:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3329 expref: 7 pid: 6702 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263331.959154:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994376150e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1875129753739392:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263331.959264:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263331.968834:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.969064:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735925760 00000100:00100000:0.0:1788263331.969074:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735925760 00010000:00010000:0.0:1788263331.969116:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3329 expref: 8 pid: 6702 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263331.969158:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:0.0:1788263331.969168:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735925760:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263331.969184:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263331.969208:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3329 expref: 8 pid: 6702 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.969259:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3329 expref: 8 pid: 6702 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.969293:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263331.969298:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263331.969307:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.969318:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263331.969369:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263331.969385:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5837:1875129753739520:192.168.201.29@tcp:105: 00000100:00100000:0.0:1788263331.969466:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30900 going to sleep for 11 seconds 00010000:00010000:2.0:1788263331.970040:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc5139568ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3329 expref: 8 pid: 6702 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263331.970058:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994376150e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1875129753739392:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263331.970082:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263331.970102:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7800, rc 0) 00000100:00100000:2.0:1788263331.970146:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+7:11573:x1875129735925632:12345-192.168.201.29@tcp:101:bash.0 Request processed in 11159us (11368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263331.970154:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1788263331.992392:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263331.992860:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5837:1875129753739520:192.168.201.29@tcp:105: 00010000:00010000:0.0:1788263331.992889:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263331.992954:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735925760:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 23786us (24129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263331.992965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:2.0:1788263331.993330:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735926016 00000100:00100000:2.0:1788263331.993338:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735926016 00000100:00100000:2.0:1788263331.993399:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1788263331.993409:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+38:11573:x1875129735926016:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:2.0:1788263331.993943:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+39:11573:x1875129735926016:12345-192.168.201.29@tcp:35:bash.0 Request processed in 534us (1560us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788263331.993951:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00010000:00010000:3.0:1788263332.029546:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263332.078831:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263332.078889:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.079248:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735926272 00000100:00100000:0.0:1788263332.079257:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735926272 00000100:00100000:0.0:1788263332.079333:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:0.0:1788263332.079345:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735926272:12345-192.168.201.29@tcp:16:kworker.0 00000100:00100000:0.0:1788263332.079492:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735926272:12345-192.168.201.29@tcp:16:kworker.0 Request processed in 149us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.079509:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00080000:1.0:1788263332.079696:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263332.080417:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735926144 00000100:00100000:3.0:1788263332.080425:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735926144 00002000:00100000:3.0:1788263332.080463:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99437630e680 x1875129735926144/t0(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:543/0 lens 504/0 e 0 to 0 dl 1788263343 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788263332.080490:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99437630e680 with x1875129735926144 ext(0->8) 00002000:00010000:3.0:1788263332.080496:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99437630e680 00000100:00100000:3.0:1788263332.080534:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788263332.080542:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fedef325-db54-4469-b29a-301ff58466df+6:2359:x1875129735926144:12345-192.168.201.29@tcp:4:bash.0 00000100:00100000:3.0:1788263332.082860:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fedef325-db54-4469-b29a-301ff58466df+8:2359:x1875129735926144:12345-192.168.201.29@tcp:4:bash.0 Request processed in 2309us (4032us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788263332.082874:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00002000:00100000:3.0:1788263332.082887:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99437630e680 x1875129735926144/t4294967308(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:543/0 lens 504/448 e 0 to 0 dl 1788263343 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788263332.082998:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99437630e680 with x1875129735926144 ext(0->8) 00002000:00010000:3.0:1788263332.083004:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99437630e680 00000001:00080000:3.0:1788263332.147289:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788263332.147316:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788263332.233731:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263332.233850:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735926400 00000100:00100000:3.0:1788263332.233862:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735926400 00000100:00100000:3.0:1788263332.233994:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:3.0:1788263332.234005:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+39:11589:x1875129735926400:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263332.234044:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263332.234068:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139568dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3337 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.234137:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139568e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.234152:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139568e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.234167:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139568e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263332.234261:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788263332.234265:0:6725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263332.234284:0:6725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139568e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.234308:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139568dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3337 expref: 41 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.234326:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139568e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3337 expref: 40 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.234334:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:3.0:1788263332.234337:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263332.234341:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d200, rc 0) 00000100:00100000:3.0:1788263332.234397:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+40:11589:x1875129735926400:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 394us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263332.234404:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:2.0:1788263332.244013:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.244151:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735926656 00000100:00100000:0.0:1788263332.244163:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735926656 00000100:00100000:0.0:1788263332.244258:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 201 00000100:00100000:0.0:1788263332.244270:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+40:11589:x1875129735926656:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263332.244293:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263332.244316:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139568ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d333e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.244428:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139568f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.244444:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139568f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.244456:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139568f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263332.244468:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788263332.244615:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139568ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d333e expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.244634:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139568f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d333e expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.244643:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99434314fb00) 00010000:00010000:0.0:1788263332.244646:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263332.244649:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659800, rc 0) 00000100:00100000:0.0:1788263332.244726:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+42:11589:x1875129735926656:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 458us (722us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788263332.244733:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 201 00000100:00100000:1.0:1788263332.250614:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.250694:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735926912 00000100:00100000:0.0:1788263332.250704:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735926912 00000100:00100000:0.0:1788263332.250766:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:0.0:1788263332.250776:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+42:11589:x1875129735926912:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263332.250803:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263332.250827:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139568ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3345 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.250950:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956906 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.250965:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.250977:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263332.250990:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788263332.251128:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139568ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3345 expref: 45 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.251145:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956906 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3345 expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.251153:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99434314fb00) 00010000:00010000:0.0:1788263332.251156:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788263332.251172:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659600, rc 0) 00000100:00100000:0.0:1788263332.251276:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+44:11589:x1875129735926912:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 502us (671us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788263332.251283:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:3.0:1788263332.261496:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263332.261563:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.262688:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735927168 00000100:00100000:0.0:1788263332.262705:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735927168 00000100:00100000:0.0:1788263332.262800:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788263332.262811:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+44:2360:x1875129735927168:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263332.262826:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263332.262854:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139568f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d333e expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.262875:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99434314fb00) 00010000:00010000:0.0:1788263332.262879:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263332.262973:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+43:2360:x1875129735927168:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 163us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.262980:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788263332.263079:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735927040 00000100:00100000:1.0:1788263332.263085:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735927040 00000100:00100000:1.0:1788263332.263140:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:1.0:1788263332.263150:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+6:2362:x1875129735927040:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:1.0:1788263332.263188:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.263207:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.263214:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788263332.263253:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263332.263257:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.263293:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.263306:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 6 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263332.263321:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875129753739648:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263332.263391:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943723309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263332.268072:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875129753739648:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263332.268124:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263332.271377:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263332.272434:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735927296 00000100:00100000:2.0:1788263332.272461:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735927296 00010000:00010000:2.0:1788263332.272662:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 7 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263332.272723:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1788263332.272736:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735927296:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263332.272757:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788263332.272786:0:5839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788263332.272789:0:5839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788263331 00002000:00010000:2.0:1788263332.272792:0:5839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788263331 00002000:00010000:2.0:1788263332.272795:0:5839:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788263332.272823:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 7 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.272845:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 7 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.272878:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005127fccc/0x1a657bc5139568d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3330 expref: 7 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.272902:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263332.272908:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263332.272914:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.272926:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.272966:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263332.273059:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+6:2361:x1875129735927296:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 326us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263332.273069:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00010000:00010000:1.0:1788263332.273447:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.273468:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.273504:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.273512:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.273520:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.273528:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b0a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263332.273533:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.273541:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.273560:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263332.273589:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ed68a3f/0x1a657bc513956914 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263332.273680:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+5:2362:x1875129735927040:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 10527us (12203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263332.273690:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:3.0:1788263332.281952:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263332.282418:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735927552 00000100:00100000:2.0:1788263332.282432:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735927552 00000100:00100000:2.0:1788263332.282521:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1788263332.282535:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+43:11589:x1875129735927552:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:2.0:1788263332.282648:0:5856:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956906 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3345 expref: 43 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263332.283049:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788263332.283104:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788263332.284187:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788263332.289901:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.289942:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3322 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.289953:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.290681:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3322 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.290705:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3322 expref: 47 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263332.290725:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a58bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1875129753739776:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263332.290847:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994352af4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263332.298547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263332.298808:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735927680 00000100:00100000:3.0:1788263332.298821:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735927680 00010000:00010000:3.0:1788263332.298875:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3322 expref: 48 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263332.298928:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:3.0:1788263332.298961:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+48:2361:x1875129735927680:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263332.298983:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263332.298992:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3322 expref: 48 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.299007:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3322 expref: 48 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.299038:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99434314fb00) 00010000:00010000:3.0:1788263332.299044:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.299054:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.299062:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.299084:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263332.299147:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fedef325-db54-4469-b29a-301ff58466df+48:2361:x1875129735927680:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 188us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263332.299155:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00010000:00010000:0.0:1788263332.299848:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139568c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3322 expref: 47 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263332.299873:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a58bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1875129753739776:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263332.299899:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.299910:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.299917:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788263332.300105:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788263332.300592:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788263332.300733:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875129753739904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788263332.300809:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263332.300858:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263332.302006:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753739904 00000100:00100000:3.0:1788263332.302024:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753739904 00000100:00100000:3.0:1788263332.302127:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263332.302142:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1875129753739904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788263332.302773:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1875129753739904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 632us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263332.302796:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263332.302858:0:5856:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788263332.302865:0:5856:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994376152a00, transno 4294967307 00000100:00100000:3.0:1788263332.302886:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875129753739904:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788263332.304438:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788263332.308054:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788263332.308187:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875129753740032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788263332.309872:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263332.309929:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f13f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263332.310076:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753740032 00000100:00100000:2.0:1788263332.310089:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753740032 00000100:00100000:2.0:1788263332.310165:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263332.310178:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1875129753740032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788263332.312127:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1875129753740032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1939us (2252us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788263332.312141:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263332.318661:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1875129753740032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788263332.318814:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788263332.318900:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.318912:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.318921:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.318927:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263332.318933:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.318942:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.318963:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99434314fb00) 00010000:00010000:0.0:1788263332.318966:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788263332.319771:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.319785:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc51395691b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263332.320106:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788263332.322841:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788263332.322879:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359110659928ns, next at 360110654058ns, rc = 0 00000001:00080000:0.0:1788263332.322901:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788263332.323005:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99434314fb00) 00010000:00010000:0.0:1788263332.323010:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788263332.323025:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956906 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3345 expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263332.323285:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2c8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+50:11589:x1875129735927552:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 40750us (41343us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788263332.323299:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000020:00080000:0.0:1788263332.323308:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788263332.328293:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.328700:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735927808 00000100:00100000:0.0:1788263332.328715:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735927808 00000100:00100000:0.0:1788263332.328797:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 203 00000100:00100000:0.0:1788263332.328810:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+50:11589:x1875129735927808:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263332.328843:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263332.328929:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956922 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d334c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.329018:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956922 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d334c expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.329036:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956922 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d334c expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.329083:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263332.329087:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263332.329092:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659600, rc 0) 00000100:00100000:0.0:1788263332.329426:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+51:11589:x1875129735927808:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 614us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.329435:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 203 00000100:00100000:3.0:1788263332.342889:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263332.343684:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735928064 00000100:00100000:2.0:1788263332.343716:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735928064 00000100:00100000:2.0:1788263332.343790:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:2.0:1788263332.343802:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+51:11589:x1875129735928064:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263332.344128:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+52:11589:x1875129735928064:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 326us (1256us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788263332.344137:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:3.0:1788263332.462749:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.462903:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735928192 00000100:00100000:0.0:1788263332.462917:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735928192 00000100:00100000:0.0:1788263332.462997:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:0.0:1788263332.463010:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+52:11599:x1875129735928192:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:0.0:1788263332.463120:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463144:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463159:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463177:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463185:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463192:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463380:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463411:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463419:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263332.463478:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463494:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463502:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463510:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463517:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263332.463522:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463530:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463545:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263332.463548:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263332.463555:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463562:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956929 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463604:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463611:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463618:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463624:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263332.463627:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463634:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463643:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994344cab400) 00010000:00010000:0.0:1788263332.463646:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263332.463649:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463654:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463670:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463676:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463682:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463694:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263332.463697:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463703:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463712:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263332.463715:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263332.463717:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.463722:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263332.463831:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+52:11599:x1875129735928192:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 819us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.463841:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:1.0:1788263332.572138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.573346:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735928448 00000100:00100000:0.0:1788263332.573365:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735928448 00000100:00100000:0.0:1788263332.573465:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 205 00000100:00100000:0.0:1788263332.573479:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+52:11602:x1875129735928448:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263332.573507:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263332.573547:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395693e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3353 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.573661:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.573706:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.573719:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.573735:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.573742:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.573747:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.573906:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513956953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.573915:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513956953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.573922:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513956953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263332.573933:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788263332.574069:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574077:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574084:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574098:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263332.574104:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574112:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574128:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263332.574131:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263332.574137:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574144:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc513956945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574161:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574167:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574174:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574179:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263332.574182:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574188:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574208:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994344cab400) 00010000:00010000:0.0:1788263332.574211:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263332.574214:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574300:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395694c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574354:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395693e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3353 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574371:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513956953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3353 expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.574380:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263332.574383:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263332.574385:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659e00, rc 0) 00000100:00100000:0.0:1788263332.574478:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+54:11602:x1875129735928448:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1001us (2353us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788263332.574487:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 205 00000100:00100000:1.0:1788263332.590031:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.590114:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735928576 00000100:00100000:0.0:1788263332.590128:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735928576 00000100:00100000:0.0:1788263332.590259:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:0.0:1788263332.590275:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+54:11602:x1875129735928576:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1788263332.590376:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.590400:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.590436:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.590485:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.590492:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.590499:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.590507:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263332.590512:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.590529:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.590543:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263332.590547:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263332.590553:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.590558:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263332.590661:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+54:11602:x1875129735928576:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 389us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.590670:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:3.0:1788263332.595198:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263332.604560:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735928832 00000100:00100000:2.0:1788263332.604591:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735928832 00000100:00100000:2.0:1788263332.604793:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:2.0:1788263332.604807:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+54:11602:x1875129735928832:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263332.605158:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+55:11602:x1875129735928832:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 352us (9973us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788263332.605167:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1788263332.605551:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753740416:0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.605742:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753740160:0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.605811:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263332.605872:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753740672:0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.605903:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753740288:0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.605954:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753740160 00000100:00100000:0.0:1788263332.605961:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753740160 00000100:00100000:0.0:1788263332.606003:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788263332.606011:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753740160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.606058:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3321:x1875129753740160:12345-0@lo:400:kworker.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.606065:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788263332.606273:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263332.606323:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263332.606354:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263332.606390:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33366ce6-2c46-49eb-9afc-8617712bc2f4:3321:1875129753740160:0@lo:400:kworker.0 00000100:00100000:1.0:1788263332.606405:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263332.606412:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753740544:0@lo:400:kworker.0 00000100:00100000:1.0:1788263332.606443:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263332.606609:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753740416 00000100:00100000:0.0:1788263332.606614:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753740416 00000100:00100000:0.0:1788263332.606726:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753740288 00000100:00100000:0.0:1788263332.606730:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753740288 00000100:00100000:0.0:1788263332.606745:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753740672 00000100:00100000:0.0:1788263332.606748:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753740672 00000100:00100000:0.0:1788263332.606766:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788263332.606782:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753740416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.606830:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753740416:12345-0@lo:400:kworker.0 Request processed in 58us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.606837:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788263332.606851:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788263332.606857:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753740288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.606888:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753740288:12345-0@lo:400:kworker.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.606893:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788263332.606918:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788263332.606924:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753740672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.606954:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753740672:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.606961:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1788263332.606978:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263332.607008:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753740544 00000100:00100000:0.0:1788263332.607012:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753740544 00000100:00100000:0.0:1788263332.607045:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788263332.607052:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753740544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.607084:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753740544:12345-0@lo:400:kworker.0 Request processed in 33us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.607091:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788263332.607109:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263332.607152:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753740416:0@lo:400:kworker.0 00000100:00100000:0.0:1788263332.607186:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753740288:0@lo:400:kworker.0 00000100:00100000:1.0:1788263332.607455:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753740544:0@lo:400:kworker.0 00000100:00100000:1.0:1788263332.607467:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753740672:0@lo:400:kworker.0 00000100:00100000:1.0:1788263332.814650:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.814895:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735929088 00000100:00100000:0.0:1788263332.814911:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735929088 00000100:00100000:0.0:1788263332.814989:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 207 00000100:00100000:0.0:1788263332.815003:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+55:11613:x1875129735929088:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788263332.815037:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263332.815042:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788263332.815081:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d200/0x1a657bc5139568e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3337 expref: 55 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.815108:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263332.815130:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263332.815149:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956968 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d335a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.815357:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395696f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.815374:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395696f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.815386:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395696f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263332.815399:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788263332.815729:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc513956968 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d335a expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.815747:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395696f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d335a expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.815756:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263332.815759:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263332.815762:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658e00, rc 0) 00000100:00100000:0.0:1788263332.815849:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+56:11613:x1875129735929088:12345-192.168.201.29@tcp:101:bash.0 Request processed in 849us (1216us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788263332.815858:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 207 00000100:00100000:3.0:1788263332.821942:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263332.822302:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735929216 00000100:00100000:2.0:1788263332.822316:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735929216 00000100:00100000:2.0:1788263332.822405:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1788263332.822419:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347295180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+56:2361:x1875129735929216:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263332.822441:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263332.822475:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc51395696f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d335a expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263332.822502:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263332.822508:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263332.822594:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347295180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+55:2361:x1875129735929216:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 178us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263332.822603:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788263332.833935:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.834201:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735929472 00000100:00100000:0.0:1788263332.834214:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735929472 00000100:00100000:0.0:1788263332.834336:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 208 00000100:00100000:0.0:1788263332.834349:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+55:11613:x1875129735929472:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:0.0:1788263332.834452:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263332.834497:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513956953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3353 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.834655:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263332.834661:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263332.834944:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.834960:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.835096:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788263332.835158:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788263332.835296:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db716dcc reply state 00000000dc6d8216 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263332.835308:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263332.835818:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+57:11613:x1875129735929472:12345-192.168.201.29@tcp:36:bash.0 Request processed in 1466us (1895us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788263332.835828:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 208 00000020:00080000:0.0:1788263332.835835:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788263332.844975:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.845792:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735929600 00000100:00100000:0.0:1788263332.845809:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735929600 00000100:00100000:0.0:1788263332.845904:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 209 00000100:00100000:0.0:1788263332.845917:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+57:11613:x1875129735929600:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788263332.845953:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263332.846000:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513956984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3361 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.846119:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.846136:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.846146:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.846169:0:5854:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.846184:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.851330:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.851357:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.851367:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.851375:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263332.851382:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.851422:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.851449:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:3.0:1788263332.851453:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263332.851457:0:3307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.851942:0:3307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.851953:0:3307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.852095:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263332.852104:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc51395697d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.859961:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.859982:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263332.860056:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788263332.860062:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263332.860092:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.860148:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513956984 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3361 expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.860175:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3361 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.861946:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263332.861951:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263332.861957:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659200, rc 0) 00000100:00100000:0.0:1788263332.862081:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+57:11613:x1875129735929600:12345-192.168.201.29@tcp:101:bash.0 Request processed in 16160us (17116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.862091:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 209 00000100:00100000:1.0:1788263332.878823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.879056:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735929856 00000100:00100000:0.0:1788263332.879069:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735929856 00000100:00100000:0.0:1788263332.879148:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:0.0:1788263332.879160:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+57:11613:x1875129735929856:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:0.0:1788263332.879503:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+58:11613:x1875129735929856:12345-192.168.201.29@tcp:35:bash.0 Request processed in 344us (695us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788263332.879524:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:2.0:1788263332.989599:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263332.989675:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735929984 00000100:00100000:0.0:1788263332.989688:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735929984 00000100:00100000:0.0:1788263332.989820:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:0.0:1788263332.989833:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+58:11619:x1875129735929984:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263332.989867:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263332.989894:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513956992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3368 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.989979:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.989996:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.990030:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263332.990076:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788263332.990079:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263332.990102:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.990146:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc513956992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3368 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.990168:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3368 expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263332.990178:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263332.990180:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263332.990184:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659a00, rc 0) 00000100:00100000:0.0:1788263332.990379:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+59:11619:x1875129735929984:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 548us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263332.990388:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:1.0:1788263333.000927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263333.001118:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735930112 00000100:00100000:0.0:1788263333.001139:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735930112 00000100:00100000:0.0:1788263333.001351:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:0.0:1788263333.001364:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+59:11619:x1875129735930112:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263333.001391:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263333.001419:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139569a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d336f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001541:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001570:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001584:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001602:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001609:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001615:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001730:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139569b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001739:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139569b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001746:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139569b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263333.001794:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788263333.001800:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263333.001823:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139569b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001849:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139569b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001858:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001865:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001872:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001878:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263333.001883:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001891:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001905:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263333.001908:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263333.001913:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001919:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659000/0x1a657bc5139569a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001934:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001941:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001952:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001957:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263333.001960:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001966:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001974:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994344cab400) 00010000:00010000:0.0:1788263333.001976:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263333.001979:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.001984:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc5139569ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.002034:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659e00/0x1a657bc5139569a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d336f expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.002050:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139569b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d336f expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.002057:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263333.002060:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263333.002063:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659c00, rc 0) 00000100:00100000:0.0:1788263333.002145:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+60:11619:x1875129735930112:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 784us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263333.002162:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:3.0:1788263333.005569:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263333.005634:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735930240 00000100:00100000:0.0:1788263333.005647:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735930240 00000100:00100000:0.0:1788263333.005731:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788263333.005746:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+60:2360:x1875129735930240:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263333.005766:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263333.005799:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659c00/0x1a657bc5139569b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d336f expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.005821:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263333.005827:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263333.005906:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347294e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+59:2360:x1875129735930240:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 164us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263333.005914:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00080000:2.0:1788263333.005992:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263333.008706:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263333.008774:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735930496 00000100:00100000:0.0:1788263333.008787:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735930496 00000100:00100000:0.0:1788263333.008864:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:0.0:1788263333.008876:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+59:11619:x1875129735930496:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263333.008903:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263333.008930:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139569bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3376 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.009096:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.009112:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3361 expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.009142:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.009188:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3361 expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.009250:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3361 expref: 60 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263333.009269:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437fd72300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753740800:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263333.009380:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263333.013757:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437fd72300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753740800:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263333.013801:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263333.015142:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263333.015262:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735930624 00000100:00100000:2.0:1788263333.015274:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735930624 00010000:00010000:2.0:1788263333.015338:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3361 expref: 61 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263333.015390:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:2.0:1788263333.015402:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+61:2361:x1875129735930624:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263333.015420:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263333.015429:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3361 expref: 61 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.015444:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3361 expref: 61 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.015470:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659200/0x1a657bc51395698b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3361 expref: 61 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.015489:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263333.015494:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.015506:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.015640:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.015677:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263333.015770:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436dc91050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+60:2361:x1875129735930624:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 367us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263333.015778:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00010000:00010000:0.0:1788263333.015882:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.015892:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263333.015920:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788263333.016126:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc5139569bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3376 expref: 61 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.016143:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3376 expref: 60 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.016164:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263333.016167:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788263333.016170:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382042200, rc 0) 00000100:00100000:0.0:1788263333.016198:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+60:11619:x1875129735930496:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 7325us (7506us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788263333.016206:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:3.0:1788263333.019391:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263333.020657:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735930880 00000100:00100000:0.0:1788263333.020674:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735930880 00000100:00100000:0.0:1788263333.020768:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788263333.020782:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+60:11619:x1875129735930880:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:0.0:1788263333.020802:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263333.020833:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956922 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d334c expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.020856:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263333.020862:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263333.020945:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+59:11619:x1875129735930880:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 166us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263333.020955:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1788263333.022880:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263333.023890:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735931008 00000100:00100000:0.0:1788263333.023904:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735931008 00000100:00100000:0.0:1788263333.023969:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:0.0:1788263333.023982:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+59:11619:x1875129735931008:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:0.0:1788263333.024110:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.024158:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.024171:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263333.024762:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788263333.025920:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+59:11619:x1875129735931008:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 1612us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263333.025935:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:3.0:1788263333.029402:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263333.029676:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735931136 00000100:00100000:2.0:1788263333.029690:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735931136 00000100:00100000:2.0:1788263333.029770:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 214 00000100:00100000:2.0:1788263333.029784:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+59:11619:x1875129735931136:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263333.029812:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263333.029839:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139569d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d337d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.029917:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.029931:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139569d8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d337d expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.029957:0:5853:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.029973:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139569d8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d337d expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.029990:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263333.029993:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263333.029998:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139569d8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d337d expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.030007:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263333.030094:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+60:11619:x1875129735931136:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 312us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263333.030102:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 214 00010000:00010000:1.0:1788263333.051428:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263333.115665:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753740928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263333.115770:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263333.116051:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753740928 00000100:00100000:3.0:1788263333.116061:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753740928 00000100:00100000:3.0:1788263333.116132:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788263333.116145:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753740928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263333.116175:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788263333.116301:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753740928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263333.116311:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788263333.116353:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753740928:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788263333.628839:0:6800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360416618130ns, next at 361416614781ns, rc = 0 00000100:00100000:1.0:1788263333.628884:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753741056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263333.628994:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263333.630138:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753741056 00000100:00100000:3.0:1788263333.630149:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753741056 00000100:00100000:3.0:1788263333.630254:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788263333.630265:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753741056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263333.630299:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263333.630831:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753741056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 566us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263333.630840:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788263333.634640:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753741056:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788263333.948699:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263333.948709:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263333.948767:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788263333.948777:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788263333.948913:0:11704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375e7f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753741184:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788263333.949022:0:11704:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346507480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263333.961055:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263333.961201:0:11704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375e7f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753741184:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263333.961764:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735931264 00000100:00100000:1.0:1788263333.961773:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735931264 00000100:00100000:1.0:1788263333.961894:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:1.0:1788263333.961905:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+60:11620:x1875129735931264:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788263333.961936:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788263333.962044:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+60:11620:x1875129735931264:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 141us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263333.962053:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:3.0:1788263333.970165:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263333.970289:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735931392 00000100:00100000:2.0:1788263333.970300:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735931392 00000100:00100000:2.0:1788263333.970379:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:2.0:1788263333.970389:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+60:11620:x1875129735931392:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788263333.970495:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970512:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970526:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970565:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970572:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970595:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970620:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970628:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970635:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263333.970670:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788263333.970673:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263333.970685:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970696:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970703:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970710:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970717:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263333.970721:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970729:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970749:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:2.0:1788263333.970752:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263333.970757:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970763:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc5139569df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970775:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970781:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970786:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970792:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263333.970794:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970799:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970806:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff99434314f800) 00010000:00010000:2.0:1788263333.970808:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263333.970810:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970815:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6a00/0x1a657bc5139569e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970838:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970844:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970850:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970855:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263333.970858:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970865:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970873:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263333.970875:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263333.970878:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263333.970883:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6200/0x1a657bc5139569ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263333.970966:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+60:11620:x1875129735931392:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 577us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263333.970975:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:3.0:1788263333.980993:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263333.981095:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735931648 00000100:00100000:0.0:1788263333.981105:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735931648 00000100:00100000:0.0:1788263333.981168:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:0.0:1788263333.981180:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+60:11620:x1875129735931648:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263333.981200:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263333.981260:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382042400/0x1a657bc5139569f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3384 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981377:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981391:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981402:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263333.981444:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788263333.981557:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981565:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981571:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981576:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382042c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263333.981581:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981590:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981603:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263333.981606:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788263333.981612:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981618:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc5139569fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981664:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042400/0x1a657bc5139569f4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3384 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981674:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:0.0:1788263333.981677:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263333.981687:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382042400/0x1a657bc5139569f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3384 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263333.981699:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382042400, rc 0) 00000100:00100000:0.0:1788263333.981759:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+61:11620:x1875129735931648:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 582us (777us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788263333.981766:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:3.0:1788263333.999128:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263334.002669:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735931776 00000100:00100000:2.0:1788263334.002687:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735931776 00000100:00100000:2.0:1788263334.002805:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:2.0:1788263334.002833:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+61:11620:x1875129735931776:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788263334.002876:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788263334.002999:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+61:11620:x1875129735931776:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 168us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.003006:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:3.0:1788263334.014353:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.014478:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735932032 00000100:00100000:0.0:1788263334.014489:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735932032 00000100:00100000:0.0:1788263334.014562:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:0.0:1788263334.014573:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+61:11620:x1875129735932032:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263334.014597:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263334.014601:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788263334.014630:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3368 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.014650:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263334.014655:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263334.014670:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382042400/0x1a657bc513956a09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d338b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263334.015112:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788263334.015363:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc513956a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.015377:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc513956a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.015388:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc513956a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.015456:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382042400/0x1a657bc513956a09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d338b expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.015471:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc513956a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d338b expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.015478:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994344cab400) 00010000:00010000:0.0:1788263334.015481:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263334.015483:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382042c00, rc 0) 00000100:00100000:0.0:1788263334.015569:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+62:11620:x1875129735932032:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 997us (1226us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788263334.015576:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:3.0:1788263334.020869:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.020948:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735932288 00000100:00100000:0.0:1788263334.020958:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735932288 00000100:00100000:0.0:1788263334.021030:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:0.0:1788263334.021039:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+62:11620:x1875129735932288:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788263334.021096:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263334.021123:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382042c00/0x1a657bc513956a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d338b expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021143:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994344cab400) 00010000:00010000:0.0:1788263334.021153:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263334.021174:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021187:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021212:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021260:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021269:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021275:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021337:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021345:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021351:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021357:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382043e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263334.021361:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021369:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021378:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:0.0:1788263334.021388:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263334.021393:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021405:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382043e00/0x1a657bc513956a1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021416:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021421:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021426:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021430:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263334.021433:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021439:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021465:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1334297f (ffff994344cab200) 00010000:00010000:0.0:1788263334.021468:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263334.021471:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.021477:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1334297f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.021563:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+61:11620:x1875129735932288:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 524us (703us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263334.021571:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:3.0:1788263334.025341:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263334.025762:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735932416 00000100:00100000:2.0:1788263334.025774:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735932416 00000100:00100000:3.0:1788263334.025995:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:3.0:1788263334.026007:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+61:11620:x1875129735932416:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263334.026029:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263334.026053:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956a2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3392 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.026094:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.026109:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.026136:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.026249:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956a2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3392 expref: 63 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.026269:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3392 expref: 62 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.026278:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:3.0:1788263334.026281:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263334.026285:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216de00, rc 0) 00000100:00100000:3.0:1788263334.026397:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+62:11620:x1875129735932416:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 391us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.026405:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:3.0:1788263334.030561:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.030694:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735932672 00000100:00100000:0.0:1788263334.030704:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735932672 00000100:00100000:0.0:1788263334.030766:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 222 00000100:00100000:0.0:1788263334.030776:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+62:11620:x1875129735932672:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788263334.030855:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.030872:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.030883:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263334.031135:0:6725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1788263334.031279:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008532a144 reply state 000000006ca3f495 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.031290:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263334.031379:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+64:11620:x1875129735932672:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 603us (837us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788263334.031387:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 222 00010000:00010000:3.0:1788263334.034041:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.034060:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.034067:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.034073:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263334.034078:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.034104:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.034121:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:3.0:1788263334.034124:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788263334.034129:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.034136:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956a3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263334.035260:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.035441:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735932800 00000100:00100000:0.0:1788263334.035451:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735932800 00000100:00100000:0.0:1788263334.035554:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:0.0:1788263334.035564:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+63:11620:x1875129735932800:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263334.035590:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263334.035608:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3399 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.035701:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3399 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.035715:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3399 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.035735:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:0.0:1788263334.035739:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263334.035742:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659600, rc 0) 00000100:00100000:0.0:1788263334.035813:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+64:11620:x1875129735932800:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 251us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263334.035821:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:3.0:1788263334.040969:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.041100:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735932928 00000100:00100000:0.0:1788263334.041109:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735932928 00000100:00100000:0.0:1788263334.041188:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:0.0:1788263334.041199:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+9:2361:x1875129735932928:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788263334.041565:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263334.041796:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+10:2361:x1875129735932928:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 597us (836us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788263334.041804:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:2.0:1788263334.044612:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.044974:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735933184 00000100:00100000:0.0:1788263334.044984:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735933184 00000100:00100000:0.0:1788263334.045133:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:0.0:1788263334.045144:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+64:11620:x1875129735933184:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788263334.045425:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+65:11620:x1875129735933184:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 282us (822us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788263334.045447:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:2.0:1788263334.049741:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263334.049825:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735933440 00000100:00100000:3.0:1788263334.049835:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735933440 00000100:00100000:3.0:1788263334.049890:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 224 00000100:00100000:3.0:1788263334.049902:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+65:11620:x1875129735933440:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788263334.050026:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+65:11620:x1875129735933440:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 126us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.050034:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 224 00000100:00100000:3.0:1788263334.053605:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263334.053994:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735933568 00000100:00100000:1.0:1788263334.054005:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735933568 00000100:00100000:1.0:1788263334.054191:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:1.0:1788263334.054202:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+65:11620:x1875129735933568:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263334.054249:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263334.054273:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1200/0x1a657bc513956a48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33a0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.054347:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.054362:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.054374:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263334.054426:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263334.054458:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.054487:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1200/0x1a657bc513956a48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a0 expref: 67 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.054505:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a0 expref: 66 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.054514:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:1.0:1788263334.054517:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788263334.054521:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0000, rc 0) 00000100:00100000:1.0:1788263334.054596:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+66:11620:x1875129735933568:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 396us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.054604:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:3.0:1788263334.058028:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263334.058364:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735933696 00000100:00100000:2.0:1788263334.058375:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735933696 00000100:00100000:2.0:1788263334.058437:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1788263334.058459:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+10:2362:x1875129735933696:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263334.058477:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263334.058499:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33a7 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263334.058527:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bba5, blocks: 0x1 00010000:00010000:2.0:1788263334.058554:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1788263334.058559:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263334.058568:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a7 expref: 11 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.058587:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a7 expref: 11 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.058621:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6c00, rc 0) 00000100:00100000:2.0:1788263334.058681:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+11:2362:x1875129735933696:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 235us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.058688:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1788263334.061628:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263334.061707:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735933952 00000100:00100000:3.0:1788263334.061716:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735933952 00000100:00100000:3.0:1788263334.061773:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 226 00000100:00100000:3.0:1788263334.061783:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+66:11620:x1875129735933952:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788263334.061892:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+66:11620:x1875129735933952:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 109us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.061911:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 226 00000100:00100000:2.0:1788263334.065613:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.065680:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735934080 00000100:00100000:0.0:1788263334.065689:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735934080 00000100:00100000:0.0:1788263334.065737:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:0.0:1788263334.065746:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+11:11620:x1875129735934080:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263334.065763:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263334.065780:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33ae expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.065808:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a7 expref: 12 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.065817:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263334.065821:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263334.065827:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.065857:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a7 expref: 12 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.065870:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a7 expref: 12 pid: 6702 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.065883:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875129753741312:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263334.065968:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263334.068186:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875129753741312:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263334.068253:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.068273:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659200, rc 0) 00000100:00100000:2.0:1788263334.068327:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+12:11620:x1875129735934080:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 2582us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.068336:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:2.0:1788263334.070613:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.070757:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735934208 00000100:00100000:0.0:1788263334.070765:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735934208 00010000:00010000:0.0:1788263334.070806:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a7 expref: 12 pid: 6702 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.070848:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1788263334.070858:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+12:2361:x1875129735934208:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263334.070873:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263334.070895:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a7 expref: 12 pid: 6702 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.070908:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a7 expref: 12 pid: 6702 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.070931:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000748e5982/0x1a657bc513956a56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a7 expref: 12 pid: 6702 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.070947:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263334.070951:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263334.070960:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.070970:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.071009:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.071037:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5839:1875129753741440:192.168.201.29@tcp:105: 00000100:00100000:0.0:1788263334.071129:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30180 going to sleep for 11 seconds 00000100:00100000:3.0:1788263334.074967:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263334.075043:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735934336 00000100:00100000:1.0:1788263334.075051:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735934336 00002000:00100000:1.0:1788263334.075095:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff994379ecf480 x1875129735934336/t0(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:545/0 lens 504/0 e 0 to 0 dl 1788263345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788263334.075107:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994379ecf480 with x1875129735934336 ext(0->12) 00002000:00010000:1.0:1788263334.075113:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994379ecf480 00000100:00100000:1.0:1788263334.075144:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788263334.075153:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fedef325-db54-4469-b29a-301ff58466df+12:2361:x1875129735934336:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788263334.075601:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fedef325-db54-4469-b29a-301ff58466df+14:2361:x1875129735934336:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 447us (641us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788263334.075614:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00002000:00100000:1.0:1788263334.075621:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff994379ecf480 x1875129735934336/t4294967320(0) o4->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:545/0 lens 504/448 e 0 to 0 dl 1788263345 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788263334.075629:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994379ecf480 with x1875129735934336 ext(0->12) 00002000:00010000:1.0:1788263334.075633:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994379ecf480 00000100:00100000:0.0:1788263334.075769:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5839:1875129753741440:192.168.201.29@tcp:105: 00010000:00010000:0.0:1788263334.075795:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263334.075818:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+13:2361:x1875129735934208:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 4962us (5215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263334.075827:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00010000:00010000:1.0:1788263334.076330:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263334.078918:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.079029:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735934464 00000100:00100000:0.0:1788263334.079039:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735934464 00000100:00100000:0.0:1788263334.079136:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:0.0:1788263334.079148:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+66:11620:x1875129735934464:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788263334.110899:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788263334.110921:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1788263334.110953:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788263334.110974:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788263334.111042:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99437fbce6c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788263334.111047:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994346b2ed00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99437fbcecc0 00000020:00080000:3.0:1788263334.111050:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994346b2e200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9943811a4000 00000020:00080000:3.0:1788263334.111066:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99434f2aacc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788263334.111070:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99434f2e2700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99434f2aa780 00000020:00080000:3.0:1788263334.111072:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99434f2e2a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99437cbb7c00 00000020:00080000:3.0:1788263334.111194:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788263334.111341:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788263334.111361:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753741568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788263334.111424:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263334.111618:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753741568 00000100:00100000:3.0:1788263334.111625:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753741568 00000100:00100000:3.0:1788263334.111682:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788263334.111692:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875129753741568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788263334.111722:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788263334.111759:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a96bba3, atime: 0x0, ctime: 0x6a96bba3, blocks: 0xb 00010000:00010000:3.0:1788263334.111767:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.111804:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788263334.111809:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263334.111815:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.111831:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.111848:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.111856:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.111872:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788263334.112350:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3320:x1875129753741568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 658us (923us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788263334.112358:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788263334.112380:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788263334.112394:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263334.112400:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.112409:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263334.112413:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.112433:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.112456:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.112464:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014674ddc/0x1a657bc513956a64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.112483:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263334.112484:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263334.112486:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263334.112497:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753741696:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788263334.112532:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788263334.112606:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994379ecfb80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788263334.112613:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753741568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788263334.112665:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753741696 00000100:00100000:0.0:1788263334.112670:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753741696 00000100:00100000:0.0:1788263334.112713:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263334.112720:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753741696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788263334.112736:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788263334.112752:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.112768:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d330d expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.112775:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788263334.112779:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263334.112790:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.112815:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d330d expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.112829:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d330d expref: 12 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.112842:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1875129753741824:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263334.112902:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f309c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788263334.113042:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263334.113172:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+20:11620:x1875129735934464:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 34025us (34262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.113181:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:1.0:1788263334.118213:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263334.118302:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263334.118378:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735934592 00000100:00100000:3.0:1788263334.118424:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735934592 00000100:00100000:3.0:1788263334.118484:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:3.0:1788263334.118494:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+13:2361:x1875129735934592:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788263334.118609:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735934720 00000100:00100000:2.0:1788263334.118614:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735934720 00010000:00010000:2.0:1788263334.118637:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d330d expref: 14 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263334.118662:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:2.0:1788263334.118676:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+14:2362:x1875129735934720:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263334.118687:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263334.118693:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d330d expref: 14 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.118706:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d330d expref: 14 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.118730:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263334.118735:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263334.118741:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.118751:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.118771:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263334.118845:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+14:2362:x1875129735934720:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 169us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.118852:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00010000:00010000:0.0:1788263334.120129:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ddd9c45/0x1a657bc513956826 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d330d expref: 13 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.120150:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1875129753741824:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788263334.120173:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.120184:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.120191:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.120200:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.120242:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.120264:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263334.120348:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263334.120355:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.120362:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263334.120367:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.120382:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.120399:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.120406:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956a6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.120423:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263334.120425:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263334.120426:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263334.120744:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753741696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8022us (8209us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788263334.120752:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1788263334.121889:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994375bf9500/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788263334.121908:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753741696:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788263334.142362:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:1.0:1788263334.142384:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:0.0:1788263334.142651:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+9:2361:x1875129735934592:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 24151us (24443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263334.142664:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000001:00080000:1.0:1788263334.143064:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1788263334.145057:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263334.145169:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735934976 00000100:00100000:3.0:1788263334.145180:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735934976 00000100:00100000:3.0:1788263334.145361:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 228 00000100:00100000:3.0:1788263334.145373:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+20:11620:x1875129735934976:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263334.145445:0:6725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263334.145474:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33a0 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.145494:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:3.0:1788263334.145499:0:6725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263334.145529:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.145551:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.145560:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263334.145777:0:6725:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031adb173 reply state 000000007876e14a transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263334.145786:0:6725:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263334.145873:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+21:11620:x1875129735934976:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 502us (826us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788263334.145878:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 228 00000100:00100000:1.0:1788263334.151200:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1788263334.151300:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.151313:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.151319:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.151342:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263334.151347:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.151354:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.151372:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:3.0:1788263334.151375:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263334.151379:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.151384:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956a72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263334.151521:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735935104 00000100:00100000:2.0:1788263334.151530:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735935104 00000100:00100000:2.0:1788263334.151595:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:2.0:1788263334.151606:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+7:2362:x1875129735935104:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788263334.151820:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788263334.151824:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788263332 00002000:00010000:2.0:1788263334.151826:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788263332 00002000:00010000:2.0:1788263334.151829:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788263333 -> 1788263332 00002000:00010000:2.0:1788263334.151831:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788263334.151896:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735935104:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 292us (706us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788263334.151913:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:0.0:1788263334.154197:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263334.154292:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735935360 00000100:00100000:1.0:1788263334.154303:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735935360 00000100:00100000:1.0:1788263334.154364:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:1.0:1788263334.154375:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+20:11620:x1875129735935360:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788263334.154436:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.154460:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3392 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.154467:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.154511:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3392 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.154520:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3392 expref: 20 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263334.154531:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753741952:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263334.154657:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263334.157124:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263334.157157:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735935488 00000100:00100000:3.0:1788263334.157163:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735935488 00000100:00100000:2.0:1788263334.157176:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1875129753741952:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263334.157197:0:8470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3392 expref: 21 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.157199:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263334.157242:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1788263334.157251:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+21:2361:x1875129735935488:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263334.157264:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263334.157270:0:8470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3392 expref: 21 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.157282:0:8470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3392 expref: 21 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.157315:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3392 expref: 21 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.157330:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:3.0:1788263334.157335:0:8470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.157342:0:8470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.157347:0:8470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.157368:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263334.157394:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.157401:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263334.157416:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fedef325-db54-4469-b29a-301ff58466df+20:2361:x1875129735935488:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 166us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.157422:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00010000:00010000:2.0:1788263334.157429:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.157435:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.157441:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.157447:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263334.157452:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.157458:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.157468:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:2.0:1788263334.157470:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788263334.157474:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.157489:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1e00/0x1a657bc513956a79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263334.157529:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fedef325-db54-4469-b29a-301ff58466df+19:11620:x1875129735935360:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 3156us (3343us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788263334.157537:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:3.0:1788263334.159520:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.159681:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735935616 00000100:00100000:0.0:1788263334.159691:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735935616 00000100:00100000:0.0:1788263334.159775:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:0.0:1788263334.159786:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+8:2360:x1875129735935616:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788263334.159831:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.159853:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.159862:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263334.159866:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263334.159871:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.159925:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.159940:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 8 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.159957:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1875129753742080:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263334.160044:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30540 going to sleep for 11 seconds 00000100:00100000:0.0:1788263334.162272:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263334.162355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735935744 00000100:00100000:2.0:1788263334.162363:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735935744 00000100:00100000:1.0:1788263334.162376:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1875129753742080:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263334.162399:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 9 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.162399:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263334.162434:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:2.0:1788263334.162444:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+9:2362:x1875129735935744:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263334.162459:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263334.162482:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 9 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.162495:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 9 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.162516:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956a5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ae expref: 9 pid: 6705 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.162531:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263334.162535:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263334.162551:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.162574:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.162602:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263334.162619:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.162627:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.162651:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263334.162653:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+8:2362:x1875129735935744:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 210us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1788263334.162659:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263334.162660:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00010000:00010000:1.0:1788263334.162667:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.162680:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263334.162685:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.162693:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.162705:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.162713:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956a80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263334.162762:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fedef325-db54-4469-b29a-301ff58466df+7:2360:x1875129735935616:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 2978us (3249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.162769:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:1.0:1788263334.164145:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263334.164209:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735936000 00000100:00100000:2.0:1788263334.164256:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735936000 00000100:00100000:2.0:1788263334.164298:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 230 00000100:00100000:2.0:1788263334.164307:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:11620:x1875129735936000:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788263334.164384:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.164402:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.164412:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.164779:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.164787:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3399 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.164793:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.164827:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3399 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.164837:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3399 expref: 20 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263334.164848:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753742208:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263334.164910:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346507900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263334.167197:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263334.167324:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753742208:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263334.167351:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.167716:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735936128 00000100:00100000:0.0:1788263334.167723:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735936128 00010000:00010000:0.0:1788263334.167760:0:8471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3399 expref: 21 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.167796:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:0.0:1788263334.167805:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+21:2361:x1875129735936128:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263334.167819:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263334.167825:0:8471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3399 expref: 21 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.167836:0:8471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3399 expref: 21 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.167859:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956a41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3399 expref: 21 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.167897:0:8471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:0.0:1788263334.167901:0:8471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.167910:0:8471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.167918:0:8471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263334.167948:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263334.168001:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fedef325-db54-4469-b29a-301ff58466df+20:2361:x1875129735936128:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 197us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263334.168008:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00010000:00010000:2.0:1788263334.168103:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.168111:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263334.168307:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788263334.168465:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788263334.168511:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788263334.168596:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5853:1875129753742336:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788263334.168643:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.168676:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346507c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263334.168736:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753742336 00000100:00100000:3.0:1788263334.168741:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753742336 00000100:00100000:3.0:1788263334.168778:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788263334.168786:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875129753742336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788263334.168862:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875129753742336:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.168869:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263334.169584:0:5853:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1788263334.169594:0:5853:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1788263334.169617:0:5853:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff994375bf9500 x1875129753741696/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788263350 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263334.169640:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5853:1875129753742336:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788263334.170105:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788263334.170174:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5853:1875129753742464:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788263334.170214:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.170697:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346507900 going to sleep for 11 seconds 00000100:00100000:3.0:1788263334.170804:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753742464 00000100:00100000:3.0:1788263334.170810:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753742464 00000100:00100000:3.0:1788263334.170859:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788263334.170870:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875129753742464:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788263334.171071:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5853:x1875129753742464:12345-0@lo:1000:mdt00_001.0 Request processed in 203us (855us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788263334.171078:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263334.171149:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5853:1875129753742464:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788263334.171179:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171188:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171195:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171201:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263334.171205:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171212:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171415:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff994352cd3d00) 00010000:00010000:2.0:1788263334.171418:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263334.171424:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171430:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7600/0x1a657bc513956a8e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171600:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171607:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171612:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171618:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382043a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263334.171621:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171627:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171635:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263334.171638:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263334.171645:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139569d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d337d expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171657:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139569d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d337d expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171665:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139569d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d337d expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.171693:0:5853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139569d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d337d expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263334.171717:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753742592:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788263334.171792:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346507900 going to sleep for 11 seconds 00000100:00100000:2.0:1788263334.174255:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1875129753742592:192.168.201.29@tcp:105: 00010000:00010000:2.0:1788263334.174289:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174299:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc5139569d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174335:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174347:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174357:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174368:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174375:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174380:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174386:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263334.174390:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174410:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174422:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263334.174424:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263334.174428:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174434:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6c00/0x1a657bc513956a95 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174458:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174464:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174470:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174475:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263334.174478:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174484:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174492:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263334.174494:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788263334.174497:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.174514:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263334.174742:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+23:11620:x1875129735936000:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 10435us (10602us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788263334.174753:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 230 00000020:00080000:2.0:1788263334.174758:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788263334.175039:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263334.175044:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263334.175636:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788263334.175646:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788263334.178336:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263334.178459:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735936256 00000100:00100000:2.0:1788263334.178469:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735936256 00000100:00100000:2.0:1788263334.178518:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:2.0:1788263334.178528:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+23:11619:x1875129735936256:12345-192.168.201.29@tcp:49:lfs.0 00000100:00100000:2.0:1788263334.178687:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+23:11619:x1875129735936256:12345-192.168.201.29@tcp:49:lfs.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.178695:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:1.0:1788263334.185151:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263334.185245:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735936512 00000100:00100000:2.0:1788263334.185256:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735936512 00000100:00100000:2.0:1788263334.185318:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:2.0:1788263334.185329:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d2cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+23:11620:x1875129735936512:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788263334.186012:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788263334.186114:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788263334.186161:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.186178:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.186189:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.186204:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.186211:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.186264:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.186594:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788263334.186700:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d2cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+25:11620:x1875129735936512:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1369us (1556us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788263334.186710:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000020:00080000:2.0:1788263334.186715:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788263334.187583:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263334.187593:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.187602:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263334.187606:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.187615:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.187631:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99434314f500) 00010000:00010000:3.0:1788263334.187634:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788263334.187638:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.187644:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7800/0x1a657bc513956a9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.187663:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263334.187665:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263334.187667:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263334.189838:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263334.189937:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735936768 00000100:00100000:0.0:1788263334.189947:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735936768 00000100:00100000:0.0:1788263334.190006:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 231 00000100:00100000:0.0:1788263334.190016:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+25:11619:x1875129735936768:12345-192.168.201.29@tcp:58:lfs.0 00000040:00080000:0.0:1788263334.190307:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788263334.190405:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+25:11619:x1875129735936768:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 389us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263334.190414:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 231 00000100:00100000:0.0:1788263334.217522:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263334.217615:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735936896 00000100:00100000:3.0:1788263334.217625:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735936896 00000100:00100000:3.0:1788263334.217682:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 232 00000100:00100000:3.0:1788263334.217692:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+25:11622:x1875129735936896:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263334.217716:0:6725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263334.217736:0:6725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956aa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33b5 expref: -99 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.217796:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.217810:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.217823:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.217837:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.217844:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.217849:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.218095:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.218107:0:6725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3376 expref: 26 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.218131:0:6725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.218167:0:6725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3376 expref: 26 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.218181:0:6725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3376 expref: 26 pid: 6725 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263334.218196:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ecea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753742720:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263334.218309:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943509c0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263334.221900:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263334.222017:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ecea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6725:1875129753742720:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263334.222045:0:6725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263334.222184:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735937152 00000100:00100000:0.0:1788263334.222192:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735937152 00000100:00100000:0.0:1788263334.222284:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:0.0:1788263334.222309:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+27:6059:x1875129735937152:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788263334.222830:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+28:6059:x1875129735937152:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 521us (938us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788263334.222837:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1788263334.225680:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263334.225756:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735937280 00000100:00100000:3.0:1788263334.225766:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735937280 00010000:00010000:3.0:1788263334.225805:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3376 expref: 28 pid: 6725 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263334.225837:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:3.0:1788263334.225846:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+28:2361:x1875129735937280:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263334.225861:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263334.225868:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3376 expref: 28 pid: 6725 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.225899:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3376 expref: 28 pid: 6725 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.225921:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc5139569c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3376 expref: 28 pid: 6725 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.225938:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:3.0:1788263334.225943:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.225953:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.225961:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.226002:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263334.226066:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fedef325-db54-4469-b29a-301ff58466df+27:2361:x1875129735937280:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 220us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.226074:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00010000:00010000:1.0:1788263334.226494:0:6725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226502:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263334.226560:0:6725:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788263334.226566:0:6725:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263334.226586:0:6725:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226599:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226608:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226614:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226621:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226627:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263334.226630:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226637:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226649:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:1.0:1788263334.226651:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263334.226654:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226660:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d800/0x1a657bc513956aaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226684:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226691:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226697:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226702:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263334.226705:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226710:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226718:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff994352cd3300) 00010000:00010000:1.0:1788263334.226721:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263334.226724:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226728:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc513956ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226764:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc513956aa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33b5 expref: 27 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226777:0:6725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33b5 expref: 26 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263334.226795:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:1.0:1788263334.226797:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263334.226800:0:6725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d000, rc 0) 00000100:00100000:1.0:1788263334.226836:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+26:11622:x1875129735936896:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 9145us (9324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.226844:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 232 00000040:00080000:1.0:1788263334.847481:0:12637:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263334.847492:0:12637:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263334.847565:0:12637:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788263334.847571:0:12637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788263335.099696:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263335.144514:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263335.144660:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735937408 00000100:00100000:0.0:1788263335.144671:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735937408 00000100:00100000:0.0:1788263335.144742:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 290 00000100:00100000:0.0:1788263335.144752:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735937408:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263335.148302:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2360:x1875129735937408:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 3539us (3788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263335.148318:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 290 00000100:00100000:1.0:1788263335.153258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263335.153334:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263335.154621:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735937536 00000100:00100000:3.0:1788263335.154634:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735937536 00000100:00100000:3.0:1788263335.154728:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:3.0:1788263335.154740:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2360:x1875129735937536:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263335.154821:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2360:x1875129735937536:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 84us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263335.154829:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00080000:2.0:1788263335.155362:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788263335.157286:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735937664 00000100:00100000:0.0:1788263335.157301:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735937664 00000100:00100000:0.0:1788263335.157387:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00100000:0.0:1788263335.157398:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735937664:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263335.157490:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2359:x1875129735937664:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 93us (4154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263335.157498:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00080000:2.0:1788263335.157826:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788263335.227482:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263335.227491:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263335.227543:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788263335.227549:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263335.227671:0:11704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379ecf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753742848:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788263335.227799:0:11704:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573900 going to sleep for 11 seconds 00000100:00100000:3.0:1788263335.232017:0:11704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379ecf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875129753742848:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788263335.238051:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263335.242289:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735937792 00000100:00100000:2.0:1788263335.242307:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735937792 00000100:00080000:3.0:1788263335.242757:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263335.242799:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00100000:2.0:1788263335.242812:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+26:11634:x1875129735937792:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788263335.242882:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788263335.243013:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+26:11634:x1875129735937792:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 204us (4972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263335.245928:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00100000:2.0:1788263335.254783:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263335.255130:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735938048 00000100:00100000:0.0:1788263335.255141:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735938048 00000100:00100000:0.0:1788263335.255207:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 234 00000100:00100000:0.0:1788263335.255234:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+26:11634:x1875129735938048:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263335.255260:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263335.255283:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956abf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33bc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263335.255407:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263335.255423:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263335.255436:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263335.255447:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788263335.255600:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659a00/0x1a657bc513956abf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33bc expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263335.255620:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33bc expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263335.255628:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263335.255631:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263335.255634:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659800, rc 0) 00000100:00100000:0.0:1788263335.255693:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+28:11634:x1875129735938048:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 477us (921us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788263335.255701:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 234 00000100:00100000:3.0:1788263335.266002:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263335.266137:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735938304 00000100:00100000:1.0:1788263335.266147:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735938304 00000100:00100000:1.0:1788263335.266210:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 235 00000100:00100000:1.0:1788263335.266268:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+28:11634:x1875129735938304:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788263335.266351:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263335.266369:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263335.266381:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263335.266593:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263335.266613:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263335.266620:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263335.266626:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263335.266630:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263335.266636:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263335.266649:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:1.0:1788263335.266651:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788263335.266656:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263335.266662:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b1800/0x1a657bc513956ad4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263335.266813:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+29:11634:x1875129735938304:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 549us (821us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788263335.266821:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 235 00000040:00080000:3.0:1788263335.266996:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263335.267002:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263335.267687:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788263335.267699:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263335.269751:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263335.269871:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735938560 00000100:00100000:2.0:1788263335.269884:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735938560 00000100:00100000:2.0:1788263335.269960:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1788263335.269981:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+29:11634:x1875129735938560:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788263335.270279:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+30:11634:x1875129735938560:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 300us (534us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788263335.270288:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:0.0:1788263335.275417:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263335.275585:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735938688 00000100:00100000:3.0:1788263335.275595:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735938688 00000100:00100000:3.0:1788263335.275995:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1788263335.276022:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+30:2362:x1875129735938688:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263335.276040:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263335.276066:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659800/0x1a657bc513956ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33bc expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263335.276086:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:3.0:1788263335.276091:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263335.276153:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fedef325-db54-4469-b29a-301ff58466df+29:2362:x1875129735938688:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 135us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263335.279772:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:3.0:1788263336.123831:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263336.587375:0:12689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263336.587385:0:12689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263336.587445:0:12689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788263336.587452:0:12689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263336.806652:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263336.806732:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735938944 00000100:00100000:0.0:1788263336.806741:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735938944 00000100:00100000:0.0:1788263336.806803:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 236 00000100:00100000:0.0:1788263336.806814:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+29:11654:x1875129735938944:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263336.806855:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263336.806876:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956adb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33c3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.807647:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956ae2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.807670:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.807688:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263336.807703:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788263336.807840:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659600/0x1a657bc513956adb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33c3 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.807856:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33c3 expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.807866:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:0.0:1788263336.807869:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788263336.807872:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658e00, rc 0) 00000100:00100000:0.0:1788263336.809480:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+31:11654:x1875129735938944:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 2657us (2828us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788263336.809502:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 236 00000100:00100000:0.0:1788263336.819396:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263336.820417:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735939072 00000100:00100000:1.0:1788263336.820427:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735939072 00000100:00100000:1.0:1788263336.820512:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 237 00000100:00100000:1.0:1788263336.820524:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+31:11654:x1875129735939072:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:1.0:1788263336.820594:0:6725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.820612:0:6725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.820624:0:6725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.820650:0:6725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.820657:0:6725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.820665:0:6725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.820671:0:6725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b0e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263336.820675:0:6725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.820682:0:6725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.820694:0:6725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:1.0:1788263336.820697:0:6725:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263336.820701:0:6725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.820715:0:6725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0e00/0x1a657bc513956af0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6725 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263336.820792:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+31:11654:x1875129735939072:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 270us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263336.820800:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 237 00000100:00100000:1.0:1788263336.903814:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263336.903902:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735939200 00000100:00100000:3.0:1788263336.903913:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735939200 00000100:00100000:3.0:1788263336.903995:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:3.0:1788263336.904006:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:2359:x1875129735939200:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:3.0:1788263336.904025:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263336.904046:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956af7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33ca expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263336.904074:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a96bba4, atime: 0x6a96bba4, ctime: 0x6a96bba4, blocks: 0xb 00010000:00010000:3.0:1788263336.904092:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1788263336.904098:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263336.904107:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956af7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ca expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.904124:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956af7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ca expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.904138:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ce00, rc 0) 00000100:00100000:3.0:1788263336.904206:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+8:2359:x1875129735939200:12345-192.168.201.29@tcp:101:cat.0 Request processed in 201us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263336.904213:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00080000:2.0:1788263336.904318:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263336.908143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263336.908255:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735939328 00000100:00100000:2.0:1788263336.908265:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735939328 00002000:00100000:2.0:1788263336.908316:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff994379ecca80 x1875129735939328/t0(0) o3->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:547/0 lens 488/0 e 0 to 0 dl 1788263347 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263336.908327:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994379ecca80 with x1875129735939328 ext(0->4095) 00002000:00010000:2.0:1788263336.908335:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994379ecca80 00000100:00100000:2.0:1788263336.908369:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788263336.908380:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fedef325-db54-4469-b29a-301ff58466df+8:2360:x1875129735939328:12345-192.168.201.29@tcp:3:cat.0 00000100:00100000:2.0:1788263336.908617:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fedef325-db54-4469-b29a-301ff58466df+8:2360:x1875129735939328:12345-192.168.201.29@tcp:3:cat.0 Request processed in 237us (480us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788263336.908625:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00002000:00100000:2.0:1788263336.908632:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff994379ecca80 x1875129735939328/t0(0) o3->fedef325-db54-4469-b29a-301ff58466df@192.168.201.29@tcp:547/0 lens 488/4536 e 0 to 0 dl 1788263347 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263336.908640:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff994379ecca80 with x1875129735939328 ext(0->4095) 00002000:00010000:2.0:1788263336.908644:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff994379ecca80 00010000:00010000:2.0:1788263337.147390:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788263337.264596:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788263337.264612:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:2.0:1788263337.728513:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753742976:0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.728595:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263337.728606:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753743104:0@lo:400:kworker.0 00000100:00100000:0.0:1788263337.728656:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263337.728660:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753743488:0@lo:400:kworker.0 00000100:00100000:0.0:1788263337.728688:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753743616:0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.728695:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263337.728719:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263337.728751:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753743232:0@lo:400:kworker.0 00000100:00100000:0.0:1788263337.728770:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263337.728786:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263337.728791:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753743360:0@lo:400:kworker.0 00000100:00100000:0.0:1788263337.728810:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263337.728841:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753743616 00000100:00100000:0.0:1788263337.728849:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753743616 00000100:00100000:0.0:1788263337.728902:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753743360 00000100:00100000:0.0:1788263337.728905:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753743360 00000100:00100000:0.0:1788263337.728928:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788263337.728937:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753743616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263337.728986:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753743616:12345-0@lo:400:kworker.0 Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263337.728992:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788263337.729009:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788263337.729015:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3320:x1875129753743360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263337.729044:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3320:x1875129753743360:12345-0@lo:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263337.729049:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788263337.729080:0:3323:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788263337.729086:0:3323:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788263337.729104:0:3323:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994379ecfb80, transno 4294967310 00000100:00100000:0.0:1788263337.729116:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753743616:0@lo:400:kworker.0 00000100:00100000:0.0:1788263337.729149:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753743360:0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.729279:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753742976 00000100:00100000:2.0:1788263337.729284:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753742976 00000100:00100000:2.0:1788263337.729315:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788263337.729322:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943499c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753742976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.729361:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943499c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3322:x1875129753742976:12345-0@lo:400:kworker.0 Request processed in 39us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.729368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788263337.730412:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753743104 00000100:00100000:2.0:1788263337.730658:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753743104 00000100:00100000:2.0:1788263337.730707:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753743488 00000100:00100000:2.0:1788263337.730710:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753743488 00000100:00100000:2.0:1788263337.730735:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753743232 00000100:00100000:2.0:1788263337.730739:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753743232 00000100:00100000:2.0:1788263337.730763:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788263337.731084:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753743104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.731170:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753743104:12345-0@lo:400:kworker.0 Request processed in 92us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.731177:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788263337.731196:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788263337.731203:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753743488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.731258:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753743488:12345-0@lo:400:kworker.0 Request processed in 56us (2564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.731265:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788263337.731277:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788263337.731284:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753743232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.731331:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753743232:12345-0@lo:400:kworker.0 Request processed in 47us (2559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.731336:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788263337.731359:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263337.731364:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263337.731367:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263337.732632:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753743104:0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.732695:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753743232:0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.732728:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753742976:0@lo:400:kworker.0 00000100:00100000:2.0:1788263337.732742:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753743488:0@lo:400:kworker.0 00000100:00100000:0.0:1788263338.150635:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263338.150863:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735939456 00000100:00100000:1.0:1788263338.150875:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735939456 00000100:00100000:1.0:1788263338.150932:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 292 00000100:00100000:1.0:1788263338.150943:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735939456:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263338.151019:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735939456:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 76us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263338.151026:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 292 00000100:00100000:0.0:1788263338.151193:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263338.151870:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263338.151899:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735939968 00000100:00100000:0.0:1788263338.151904:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735939968 00000100:00100000:0.0:1788263338.151953:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 146 00000100:00100000:0.0:1788263338.151963:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735939968:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263338.152009:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:584ba373-7851-453b-ba8f-f510758f1581+5:2361:x1875129735939968:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263338.152016:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 146 00000100:00080000:0.0:1788263338.152035:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263338.153406:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735939712 00000100:00100000:2.0:1788263338.153416:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735939712 00000100:00100000:2.0:1788263338.153489:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:2.0:1788263338.153499:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+8:2361:x1875129735939712:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263338.153556:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+8:2361:x1875129735939712:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 60us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263338.153564:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00080000:1.0:1788263338.153750:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263338.156263:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263338.156301:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263338.162357:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735939584 00000100:00100000:3.0:1788263338.162481:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735939584 00000100:00100000:3.0:1788263338.162675:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00100000:3.0:1788263338.163137:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+31:2361:x1875129735939584:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263338.163259:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+31:2361:x1875129735939584:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 130us (7004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263338.163268:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00080000:0.0:1788263338.163824:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263338.164327:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735939840 00000100:00100000:3.0:1788263338.164335:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735939840 00000100:00100000:3.0:1788263338.164570:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:3.0:1788263338.164580:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735939840:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263338.164641:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735939840:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 63us (8340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263338.164649:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00080000:3.0:1788263338.164667:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788263338.172388:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263338.240620:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753743744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263338.240702:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263338.240780:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753743744 00000100:00100000:2.0:1788263338.240788:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753743744 00000100:00100000:2.0:1788263338.240836:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788263338.240847:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753743744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263338.240893:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263338.240941:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753743744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263338.240949:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788263338.240999:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753743744:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788263338.747628:0:6800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365535407244ns, next at 366535404472ns, rc = 0 00000100:00100000:0.0:1788263338.747709:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753743872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263338.747789:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263338.747927:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753743872 00000100:00100000:2.0:1788263338.747937:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753743872 00000100:00100000:2.0:1788263338.747994:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788263338.748005:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753743872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263338.748042:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263338.748096:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753743872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263338.748104:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788263338.748275:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753743872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263339.197743:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788263339.358054:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1788263339.358084:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1788263339.358095:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788263339.396572:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000004:00080000:2.0:1788263339.396598:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:2.0:1788263339.396627:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994346507c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788263339.396633:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994346b2e900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9943465076c0 00000020:00080000:2.0:1788263339.396636:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994346b2ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994379ec9400 00000020:00080000:2.0:1788263339.396656:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788263339.396722:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788263339.396932:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788263339.396953:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753744000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788263339.397029:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263339.397105:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753744000 00000100:00100000:2.0:1788263339.397125:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753744000 00000100:00100000:2.0:1788263339.397565:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788263339.397575:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753744000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788263339.397768:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788263339.397772:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788263332 -> 1788263332 00002000:00010000:2.0:1788263339.397775:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788263332 -> 1788263332 00002000:00010000:2.0:1788263339.397777:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788263332 -> 1788263332 00002000:00010000:2.0:1788263339.397779:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788263339.397827:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753744000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 252us (797us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788263339.397834:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788263339.397855:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263339.397883:0:3322:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1788263339.397888:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994375bf9500, transno 4294967321 00000004:00080000:2.0:1788263339.397896:0:3322:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1788263339.397917:0:3322:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9943509f4e00 x1875129753744000/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788263355 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788263339.397928:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9943509f4e00/2, rc 0, transno 4294967324 00000100:00100000:2.0:1788263339.397933:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943509f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753744000:0@lo:2:osp-syn-0-0.0 00000040:00080000:1.0:1788263339.408096:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263339.408110:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263339.408153:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788263339.408160:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788263340.220097:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263341.249025:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263341.493335:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263341.493448:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735940096 00000100:00100000:0.0:1788263341.493459:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735940096 00000100:00100000:0.0:1788263341.493544:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 238 00000100:00100000:0.0:1788263341.493555:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+18:11299:x1875129735940096:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788263341.493676:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fedef325-db54-4469-b29a-301ff58466df+18:11299:x1875129735940096:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 122us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263341.493684:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 238 00000100:00080000:2.0:1788263341.495123:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263341.496303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263341.496626:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735940352 00000100:00100000:0.0:1788263341.496636:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735940352 00000100:00100000:0.0:1788263341.496824:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:0.0:1788263341.496835:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+18:11299:x1875129735940352:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788263341.497586:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+19:11299:x1875129735940352:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 750us (1284us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788263341.497597:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:3.0:1788263341.838070:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263341.839103:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735940480 00000100:00100000:1.0:1788263341.839116:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735940480 00000100:00100000:1.0:1788263341.839288:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 239 00000100:00100000:1.0:1788263341.839301:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:12107:x1875129735940480:12345-192.168.201.29@tcp:101:lsof.0 00010000:00010000:1.0:1788263341.839321:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263341.839354:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc513956afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33d1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.839427:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.839440:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.839451:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263341.839486:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788263341.839490:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263341.839510:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.839533:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0800/0x1a657bc513956afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33d1 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.839550:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33d1 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.839557:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5f00) 00010000:00010000:1.0:1788263341.839559:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263341.839562:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0000, rc 0) 00000100:00100000:1.0:1788263341.839643:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+6:12107:x1875129735940480:12345-192.168.201.29@tcp:101:lsof.0 Request processed in 346us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263341.839657:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 239 00000100:00080000:2.0:1788263341.840270:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788263342.267667:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263342.843558:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753744384:0@lo:400:kworker.0 00000100:00100000:0.0:1788263342.843643:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263342.843712:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788263342.843718:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753744256:0@lo:400:kworker.0 00000100:00100000:0.0:1788263342.843743:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263342.843763:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753744768:0@lo:400:kworker.0 00000100:00100000:0.0:1788263342.843789:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263342.844107:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753744128:0@lo:400:kworker.0 00000100:00100000:2.0:1788263342.844143:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263342.844175:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753744128 00000100:00100000:2.0:1788263342.844183:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753744128 00000100:00100000:2.0:1788263342.844270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788263342.844280:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753744128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263342.844342:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753744128:12345-0@lo:400:kworker.0 Request processed in 63us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263342.844349:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788263342.844412:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753744384 00000100:00100000:2.0:1788263342.844417:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753744384 00000100:00100000:2.0:1788263342.844451:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753744256 00000100:00100000:2.0:1788263342.844455:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753744256 00000100:00100000:2.0:1788263342.844474:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788263342.844481:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753744384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263342.844514:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753744384:12345-0@lo:400:kworker.0 Request processed in 34us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263342.844520:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788263342.844532:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788263342.844538:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943812b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753744256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263342.844565:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943812b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753744256:12345-0@lo:400:kworker.0 Request processed in 28us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263342.844571:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788263342.844587:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263342.844610:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753744768 00000100:00100000:2.0:1788263342.844614:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753744768 00000100:00100000:2.0:1788263342.844646:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788263342.844654:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753744768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263342.844684:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753744768:12345-0@lo:400:kworker.0 Request processed in 32us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263342.844690:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788263342.844713:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263342.844877:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753744512:0@lo:400:kworker.0 00000100:00100000:1.0:1788263342.844912:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263342.845370:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753744768:0@lo:400:kworker.0 00000100:00100000:0.0:1788263342.845386:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753744384:0@lo:400:kworker.0 00000100:00100000:0.0:1788263342.845422:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753744256:0@lo:400:kworker.0 00000100:00100000:2.0:1788263342.845496:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753744512 00000100:00100000:2.0:1788263342.845501:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753744512 00000100:00100000:2.0:1788263342.845544:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788263342.845552:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753744512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263342.845599:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753744512:12345-0@lo:400:kworker.0 Request processed in 48us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263342.845605:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788263342.846053:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263342.846302:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753744128:0@lo:400:kworker.0 00000100:00100000:1.0:1788263342.846323:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753744640:0@lo:400:kworker.0 00000100:00100000:1.0:1788263342.846360:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263342.846542:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753744640 00000100:00100000:3.0:1788263342.846548:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753744640 00000100:00100000:3.0:1788263342.846603:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788263342.846610:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753744640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263342.846652:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753744640:12345-0@lo:400:kworker.0 Request processed in 43us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263342.846671:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788263342.846750:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753744512:0@lo:400:kworker.0 00000100:00080000:0.0:1788263342.847001:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263342.847062:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753744640:0@lo:400:kworker.0 00010000:00010000:2.0:1788263343.297977:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263343.339047:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263343.339093:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263343.339134:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263343.339134:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735940736 00000100:00100000:1.0:1788263343.339147:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735940736 00000100:00100000:2.0:1788263343.339171:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263343.339198:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263343.339247:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735940992 00000100:00100000:2.0:1788263343.339251:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735940992 00000100:00100000:1.0:1788263343.339256:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735941120 00000100:00100000:1.0:1788263343.339261:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735941120 00000100:00100000:1.0:1788263343.339299:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 151 00000100:00100000:2.0:1788263343.339310:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735940864 00000100:00100000:1.0:1788263343.339312:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:2361:x1875129735940736:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263343.339315:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735940864 00000100:00100000:2.0:1788263343.339348:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:2.0:1788263343.339357:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735940992:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263343.339419:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735940992:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 63us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263343.339427:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:2.0:1788263343.339444:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:2.0:1788263343.339452:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735940864:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263343.339457:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fedef325-db54-4469-b29a-301ff58466df+19:2361:x1875129735940736:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 146us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263343.339467:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 151 00000100:00100000:2.0:1788263343.339487:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735940864:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 35us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263343.339489:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 152 00000100:00100000:1.0:1788263343.339497:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+6:2361:x1875129735941120:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263343.339512:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:1.0:1788263343.339529:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+6:2361:x1875129735941120:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263343.339536:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 152 00000100:00080000:1.0:1788263343.339562:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263343.339568:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263343.339571:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263343.339675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735940608 00000100:00100000:0.0:1788263343.339680:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735940608 00000100:00100000:0.0:1788263343.339715:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 294 00000100:00100000:0.0:1788263343.339722:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735940608:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263343.339760:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735940608:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 38us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263343.339767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 294 00000100:00100000:3.0:1788263343.357093:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263343.357123:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753744896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263343.357209:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263343.359179:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753744896 00000100:00100000:2.0:1788263343.359193:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753744896 00000100:00100000:2.0:1788263343.359292:0:11722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788263343.359310:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753744896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263343.359347:0:11722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263343.359441:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753744896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263343.359449:0:11722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263343.360467:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753744896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263343.869590:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263343.869617:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753745024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263343.869701:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263343.873041:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753745024 00000100:00100000:0.0:1788263343.873059:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753745024 00000100:00100000:0.0:1788263343.873140:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263343.873150:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994343ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753745024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263343.873189:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263343.873326:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994343ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753745024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (3623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263343.873333:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788263343.874053:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753745024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788263344.315597:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788263344.447959:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788263344.447985:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788263344.448046:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788263344.448069:0:5886:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1788263344.449458:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:02000400:3.0:1788263345.108121:0:12896:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:49:03 (1788263343) 00010000:00010000:2.0:1788263345.340088:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263346.367126:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263347.404013:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263347.963739:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753745536:0@lo:400:kworker.0 00000100:00100000:0.0:1788263347.963753:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753745280:0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.963859:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753745152:0@lo:400:kworker.0 00000100:00100000:0.0:1788263347.963879:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263347.963910:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263347.963941:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753745792:0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.963946:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994380630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753745664:0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.963984:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263347.963987:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263347.964018:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263347.964027:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753745408:0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.964030:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753745152 00000100:00100000:3.0:1788263347.964038:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753745152 00000100:00100000:0.0:1788263347.964054:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263347.964084:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788263347.964093:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753745152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263347.964192:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753745280 00000100:00100000:2.0:1788263347.964414:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753745280 00000100:00100000:2.0:1788263347.964447:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753745664 00000100:00100000:2.0:1788263347.964450:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753745664 00000100:00100000:2.0:1788263347.964470:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753745408 00000100:00100000:2.0:1788263347.964473:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753745408 00000100:00100000:2.0:1788263347.964486:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788263347.964492:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753745280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263347.965196:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753745792 00000100:00100000:0.0:1788263347.965202:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753745792 00000100:00100000:0.0:1788263347.965479:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788263347.965489:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753745792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.970197:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753745152:12345-0@lo:400:kworker.0 Request processed in 6093us (6276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263347.970214:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788263347.970320:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788263347.970335:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753745664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.970403:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753745664:12345-0@lo:400:kworker.0 Request processed in 74us (6420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263347.970422:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788263347.970441:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788263347.970448:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753745408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.970488:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753745408:12345-0@lo:400:kworker.0 Request processed in 40us (6434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263347.970494:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788263347.970544:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753745152:0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.970559:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753745664:0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.970601:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753745408:0@lo:400:kworker.0 00000100:00080000:3.0:1788263347.970650:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263347.970656:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263347.971731:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263347.971771:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753745280:12345-0@lo:400:kworker.0 Request processed in 7276us (7891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263347.971793:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788263347.971843:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753745280:0@lo:400:kworker.0 00000100:00100000:3.0:1788263347.971890:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753745536 00000100:00100000:3.0:1788263347.971898:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753745536 00000100:00100000:3.0:1788263347.971962:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788263347.971971:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753745536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263347.972044:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753745792:12345-0@lo:400:kworker.0 Request processed in 6556us (8059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263347.972052:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753745536:12345-0@lo:400:kworker.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263347.972058:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788263347.972066:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788263347.972654:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263347.975652:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753745792:0@lo:400:kworker.0 00000100:00100000:2.0:1788263347.975706:0:3322:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788263347.975728:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9943509f4e00, transno 4294967324 00000100:00100000:2.0:1788263347.975758:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994380633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753745536:0@lo:400:kworker.0 00010000:00010000:0.0:1788263348.424186:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263348.454047:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263348.454089:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263348.454125:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263348.454163:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263348.454187:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263348.454461:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735941760 00000100:00100000:3.0:1788263348.454472:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735941760 00000100:00100000:3.0:1788263348.454545:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735941376 00000100:00100000:3.0:1788263348.454549:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735941376 00000100:00100000:3.0:1788263348.454572:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 156 00000100:00100000:3.0:1788263348.454582:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+6:2361:x1875129735941760:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263348.454659:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:584ba373-7851-453b-ba8f-f510758f1581+6:2361:x1875129735941760:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 78us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263348.454667:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 156 00000100:00100000:3.0:1788263348.454685:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 157 00000100:00100000:3.0:1788263348.454692:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+18:2361:x1875129735941376:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263348.454717:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+18:2361:x1875129735941376:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263348.454723:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 157 00000100:00100000:3.0:1788263348.455007:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735941504 00000100:00100000:3.0:1788263348.455012:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735941504 00000100:00100000:3.0:1788263348.455129:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735941632 00000100:00100000:3.0:1788263348.455132:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735941632 00000100:00100000:3.0:1788263348.455285:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:3.0:1788263348.455305:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735941504:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263348.455344:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+7:2361:x1875129735941504:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 52us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263348.455351:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:3.0:1788263348.455364:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:3.0:1788263348.455370:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735941632:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263348.455391:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2361:x1875129735941632:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263348.455407:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:0.0:1788263348.455505:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735941248 00000100:00100000:0.0:1788263348.455516:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735941248 00000100:00100000:0.0:1788263348.455564:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 296 00000100:00100000:0.0:1788263348.455574:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735941248:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:1.0:1788263348.455593:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263348.455599:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263348.455602:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263348.455608:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735941248:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 35us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263348.455616:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 296 00000100:00100000:0.0:1788263348.479159:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263348.479184:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753745920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263348.479284:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263348.479395:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753745920 00000100:00100000:3.0:1788263348.479405:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753745920 00000100:00100000:3.0:1788263348.479466:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788263348.479477:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753745920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263348.479513:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263348.479564:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376152680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753745920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263348.479574:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788263348.479662:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753745920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263348.990171:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753746048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263348.990313:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263348.990390:0:11722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753746048 00000100:00100000:2.0:1788263348.990398:0:11722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753746048 00000100:00100000:2.0:1788263348.990454:0:11722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788263348.990464:0:11722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753746048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263348.990505:0:11722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263348.990551:0:11722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753746048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263348.990558:0:11722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788263348.990601:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753746048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263349.438556:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788263349.629462:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263349.629473:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263349.633500:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788263349.633516:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263350.066137:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263350.066436:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735942016 00000100:00100000:0.0:1788263350.066445:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735942016 00000100:00100000:0.0:1788263350.066525:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:0.0:1788263350.066536:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+18:12328:x1875129735942016:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:0.0:1788263350.066901:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+19:12328:x1875129735942016:12345-192.168.201.29@tcp:35:umount.0 Request processed in 366us (773us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788263350.066910:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00080000:1.0:1788263350.067845:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263350.074063:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263350.074471:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735942272 00000100:00100000:0.0:1788263350.074481:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735942272 00000100:00100000:0.0:1788263350.074548:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:0.0:1788263350.074559:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+19:12328:x1875129735942272:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:0.0:1788263350.074903:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+20:12328:x1875129735942272:12345-192.168.201.29@tcp:35:umount.0 Request processed in 345us (848us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788263350.074911:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:3.0:1788263350.081197:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263350.086137:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735942528 00000100:00100000:0.0:1788263350.086153:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735942528 00000100:00100000:0.0:1788263350.086844:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:0.0:1788263350.086872:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99436d286450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+20:12328:x1875129735942528:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:0.0:1788263350.087133:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99436d286450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fedef325-db54-4469-b29a-301ff58466df+21:12328:x1875129735942528:12345-192.168.201.29@tcp:35:umount.0 Request processed in 263us (5946us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788263350.087142:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:3.0:1788263350.090483:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263350.092653:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735942784 00000100:00100000:2.0:1788263350.092668:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735942784 00000100:00100000:2.0:1788263350.092884:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:2.0:1788263350.092895:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+21:12328:x1875129735942784:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:2.0:1788263350.093906:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fedef325-db54-4469-b29a-301ff58466df+22:12328:x1875129735942784:12345-192.168.201.29@tcp:35:umount.0 Request processed in 1009us (3637us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788263350.093917:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1788263350.099634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263350.099748:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263350.099782:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263350.099873:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263350.100401:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735942912 00000100:00100000:2.0:1788263350.100413:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735942912 00000100:00100000:2.0:1788263350.100472:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:2.0:1788263350.100482:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+5:2358:x1875129735942912:12345-192.168.201.29@tcp:9:umount.0 00000020:00000080:2.0:1788263350.103359:0:6702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955e55 00000100:00080000:2.0:1788263350.103382:0:6702:0:(import.c:65:import_set_state_nolock()) ffff99434646d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263350.103433:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788263350.103758:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fedef325-db54-4469-b29a-301ff58466df+2:2358:x1875129735942912:12345-192.168.201.29@tcp:9:umount.0 Request processed in 3272us (4129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263350.103770:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00010000:00010000:2.0:1788263350.103806:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263350.105174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735943168 00000100:00100000:1.0:1788263350.105186:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735943168 00000100:00100000:3.0:1788263350.108641:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263350.109295:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735943680 00000100:00100000:1.0:1788263350.109307:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735943680 00000100:00100000:1.0:1788263350.109374:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:1.0:1788263350.109385:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+7:2358:x1875129735943680:12345-192.168.201.29@tcp:9:umount.0 00000020:00000080:1.0:1788263350.109417:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc5139560bd 00000020:00010000:1.0:1788263350.109426:0:6705:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99434646d000: total 0 00000100:00080000:1.0:1788263350.109430:0:6705:0:(import.c:65:import_set_state_nolock()) ffff994346468800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263350.109475:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788263350.111508:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fedef325-db54-4469-b29a-301ff58466df+5:2358:x1875129735943680:12345-192.168.201.29@tcp:9:umount.0 Request processed in 2116us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263350.112456:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00080000:1.0:1788263350.112494:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263350.112499:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:1.0:1788263350.112508:0:5840:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99434646d000: total 0 00010000:00010000:1.0:1788263350.113136:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99434646d000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788263350.113629:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956af7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ca expref: 4 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263350.113688:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956459 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31fc expref: 3 pid: 8112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263350.113703:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99434646d000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788263350.113718:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263350.113720:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263350.113723:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263350.113774:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735943040 00000100:00100000:1.0:1788263350.113780:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735943040 00000100:00100000:1.0:1788263350.113807:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735943296 00000100:00100000:1.0:1788263350.113809:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735943296 00000100:00100000:1.0:1788263350.113824:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788263350.113832:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b18c11e-0696-4540-97e4-82aaa1c0495b+15:2361:x1875129735943168:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263350.113844:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263350.113854:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943821f5200/0x1a657bc513955ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f24 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263350.113864:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263350.113909:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b18c11e-0696-4540-97e4-82aaa1c0495b+14:2361:x1875129735943168:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 77us (14161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263350.113915:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788263350.113927:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788263350.113932:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b18c11e-0696-4540-97e4-82aaa1c0495b+13:2361:x1875129735943040:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263350.113939:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263350.113945:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031600/0x1a657bc513955b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f5c expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263350.113959:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263350.113973:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b18c11e-0696-4540-97e4-82aaa1c0495b+12:2361:x1875129735943040:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 41us (14192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263350.113979:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788263350.113990:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:1.0:1788263350.113995:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:2361:x1875129735943296:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263350.114002:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263350.114010:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d7c00/0x1a657bc513955d91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3027 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263350.114019:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263350.114034:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2361:x1875129735943296:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 39us (14161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263350.115635:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1788263350.148843:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263350.148967:0:6725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735944704 00000100:00100000:0.0:1788263350.148977:0:6725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735944704 00000100:00100000:0.0:1788263350.149049:0:6725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 240 00000100:00100000:0.0:1788263350.149060:0:6725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+22:2358:x1875129735944704:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:0.0:1788263350.149096:0:6725:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955af1 00000020:00010000:0.0:1788263350.149114:0:6725:0:(genops.c:1921:obd_stale_export_put()) Put export ffff994375d85000: total 0 00000100:00080000:0.0:1788263350.149119:0:6725:0:(import.c:65:import_set_state_nolock()) ffff994346b73000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788263350.149148:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788263350.149576:0:6725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fedef325-db54-4469-b29a-301ff58466df+21:2358:x1875129735944704:12345-192.168.201.29@tcp:39:umount.0 Request processed in 516us (741us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788263350.149585:0:6725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 240 00000020:00010000:2.0:1788263350.149704:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff994375d85000: total 0 00010000:00010000:2.0:1788263350.149708:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263350.149756:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994375d85000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788263350.149789:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263350.149793:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263350.149801:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216d000/0x1a657bc513956ab8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33b5 expref: 20 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.149820:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5f00) 00010000:00010000:2.0:1788263350.149823:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263350.149827:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc5139564bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3218 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.149839:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99434314f300) 00010000:00010000:2.0:1788263350.149842:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263350.149846:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513955dd7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d303c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.149863:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263350.149865:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263350.149869:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395641a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31e7 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.149900:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994344cabf00) 00010000:00010000:2.0:1788263350.149903:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263350.149907:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658800/0x1a657bc513955dbb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3035 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.149923:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263350.149926:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788263350.149930:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380659400/0x1a657bc513956444 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31f5 expref: 15 pid: 6725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.149942:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:2.0:1788263350.149945:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788263350.149949:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139567b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d32f1 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.149960:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263350.149963:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788263350.149966:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658e00/0x1a657bc513956ae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33c3 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.149977:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263350.149979:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788263350.149983:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513956118 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3123 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.149994:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff994344cab100) 00010000:00010000:2.0:1788263350.149997:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788263350.150008:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658600/0x1a657bc5139564d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d321f expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.150025:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9943565b5300) 00010000:00010000:2.0:1788263350.150028:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263350.150032:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658400/0x1a657bc51395633a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d31af expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.150046:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff994344cab700) 00010000:00010000:2.0:1788263350.150048:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788263350.150052:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994380658a00/0x1a657bc513955e2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3051 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.150067:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff994344cab500) 00010000:00010000:2.0:1788263350.150070:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263350.150073:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc5139569d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d337d expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.150087:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994375d85000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788263350.150102:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263350.150104:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263350.150106:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263350.459462:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263351.483519:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263352.507870:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263352.576991:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263352.577045:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263352.577091:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735944960 00000100:00100000:2.0:1788263352.577105:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735944960 00000100:00100000:2.0:1788263352.577181:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735945088 00000100:00100000:2.0:1788263352.577185:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735945088 00000100:00100000:2.0:1788263352.577213:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788263352.577253:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:2362:x1875129735944960:12345-192.168.201.29@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788263352.577561:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:3.0:1788263352.577571:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b18c11e-0696-4540-97e4-82aaa1c0495b+11:2362:x1875129735945088:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263352.577600:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263352.577619:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216c000/0x1a657bc513955d8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3020 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263352.577636:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263352.577693:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b18c11e-0696-4540-97e4-82aaa1c0495b+10:2362:x1875129735945088:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 125us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263352.577701:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00010000:00010000:2.0:1788263352.577851:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263352.577861:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994382042000/0x1a657bc513955bc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f71 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263352.577870:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263352.577900:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:2362:x1875129735944960:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 649us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263352.577906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:3.0:1788263352.581254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263352.581620:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735944832 00000100:00100000:0.0:1788263352.581631:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735944832 00000100:00100000:0.0:1788263352.581691:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788263352.581701:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2b18c11e-0696-4540-97e4-82aaa1c0495b+8:2359:x1875129735944832:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263352.581716:0:8471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263352.581734:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994382043400/0x1a657bc513955bca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f9b expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263352.581752:0:8471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263352.581807:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2b18c11e-0696-4540-97e4-82aaa1c0495b+7:2359:x1875129735944832:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 107us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263352.581827:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:3.0:1788263352.598907:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263352.599980:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735945344 00000100:00100000:1.0:1788263352.599993:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735945344 00000100:00100000:1.0:1788263352.600093:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 241 00000100:00100000:1.0:1788263352.600105:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+6:2358:x1875129735945344:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:1.0:1788263352.600146:0:5853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955bd8 00000020:00010000:1.0:1788263352.600166:0:5853:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99437cb25800: total 0 00000100:00080000:1.0:1788263352.600171:0:5853:0:(import.c:65:import_set_state_nolock()) ffff99437cb20800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263352.600195:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00080000:3.0:1788263352.600402:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263352.600688:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:584ba373-7851-453b-ba8f-f510758f1581+5:2358:x1875129735945344:12345-192.168.201.29@tcp:39:umount.0 Request processed in 582us (1793us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788263352.600712:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 241 00000020:00010000:1.0:1788263352.600746:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99437cb25800: total 0 00010000:00010000:1.0:1788263352.600791:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99437cb25800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788263352.600826:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943565b5f00) 00010000:00010000:1.0:1788263352.600830:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263352.600838:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99437f6b0000/0x1a657bc513956b05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33d1 expref: 4 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263352.600861:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99437cb25800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788263352.600872:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263352.600874:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263352.600876:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263352.639960:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263352.640116:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735945600 00000100:00100000:1.0:1788263352.640135:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735945600 00000100:00100000:1.0:1788263352.640187:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 297 00000100:00100000:1.0:1788263352.640199:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+7:2358:x1875129735945600:12345-192.168.201.29@tcp:251:umount.0 00000020:00000080:1.0:1788263352.640293:0:5846:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955ace 00000020:00010000:1.0:1788263352.640302:0:5846:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9942421ac800: total 0 00000100:00080000:1.0:1788263352.640306:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9942421ad000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788263352.640368:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b18c11e-0696-4540-97e4-82aaa1c0495b+3:2358:x1875129735945600:12345-192.168.201.29@tcp:251:umount.0 Request processed in 172us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263352.640374:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 297 00000020:00010000:1.0:1788263352.640576:0:5840:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9942421ac800: total 0 00010000:00010000:1.0:1788263352.640580:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263352.640627:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9942421ac800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788263352.640658:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340030a00/0x1a657bc513955b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d2f63 expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263352.640681:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9942421ac800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788263352.640687:0:5840:0:(genops.c:885:class_export_put()) final put ffff9942421ac800/2b18c11e-0696-4540-97e4-82aaa1c0495b 00010000:00010000:1.0:1788263352.640698:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263352.640700:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263352.640701:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263352.640707:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff9942421ac800/2b18c11e-0696-4540-97e4-82aaa1c0495b for MGS 00000020:00000080:1.0:1788263352.640733:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942421ad000 for MGS 00000001:00100000:3.0:1788263352.703558:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:3.0:1788263352.703566:0:7662:0:(genops.c:885:class_export_put()) final put ffff99434646f000/fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:1.0:1788263352.703625:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99434646f000/fedef325-db54-4469-b29a-301ff58466df for lustre-OST0001 00000020:00000080:1.0:1788263352.703679:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99434646d800 for lustre-OST0001 00000100:00100000:1.0:1788263353.083611:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753746432:0@lo:400:kworker.0 00000100:00100000:1.0:1788263353.083701:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263353.083781:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788263353.083787:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753746304:0@lo:400:kworker.0 00000100:00100000:1.0:1788263353.083810:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263353.083828:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753746816:0@lo:400:kworker.0 00000100:00100000:1.0:1788263353.083853:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263353.083893:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753746432 00000100:00100000:1.0:1788263353.083902:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753746432 00000100:00100000:1.0:1788263353.083962:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753746304 00000100:00100000:1.0:1788263353.083965:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753746304 00000100:00100000:1.0:1788263353.083987:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788263353.083997:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753746432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263353.084053:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753746432:12345-0@lo:400:kworker.0 Request processed in 56us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263353.084062:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788263353.084079:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788263353.084102:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753746304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263353.084130:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753746304:12345-0@lo:400:kworker.0 Request processed in 29us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263353.084136:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788263353.084154:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263353.084198:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753746304:0@lo:400:kworker.0 00000100:00100000:1.0:1788263353.084257:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753746432:0@lo:400:kworker.0 00000100:00100000:3.0:1788263353.086533:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753746176:0@lo:400:kworker.0 00000100:00100000:3.0:1788263353.086645:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263353.086716:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753746688:0@lo:400:kworker.0 00000100:00100000:3.0:1788263353.086748:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263353.086788:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263353.086795:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753746560:0@lo:400:kworker.0 00000100:00100000:3.0:1788263353.086823:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263353.086942:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753746176 00000100:00100000:0.0:1788263353.086954:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753746176 00000100:00100000:0.0:1788263353.087022:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788263353.087035:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753746176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263353.087106:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994349882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753746176:12345-0@lo:400:kworker.0 Request processed in 74us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263353.087114:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788263353.087187:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753746176:0@lo:400:kworker.0 00000100:00100000:2.0:1788263353.087422:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753746816 00000100:00100000:2.0:1788263353.087428:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753746816 00000100:00100000:2.0:1788263353.087485:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753746560 00000100:00100000:2.0:1788263353.087488:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753746560 00000100:00100000:2.0:1788263353.087511:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788263353.087519:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753746816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263353.087568:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753746816:12345-0@lo:400:kworker.0 Request processed in 51us (3713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263353.087574:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788263353.087587:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788263353.087594:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753746560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263353.087628:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753746560:12345-0@lo:400:kworker.0 Request processed in 34us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263353.087634:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788263353.087671:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753746816:0@lo:400:kworker.0 00000100:00100000:2.0:1788263353.087697:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753746560:0@lo:400:kworker.0 00000100:00100000:1.0:1788263353.089303:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753746688 00000100:00100000:1.0:1788263353.089323:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753746688 00000100:00100000:1.0:1788263353.089420:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788263353.089432:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753746688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263353.089554:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753746688:12345-0@lo:400:kworker.0 Request processed in 124us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263353.089561:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788263353.090254:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263353.090261:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263353.090265:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263353.090389:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753746688:0@lo:400:kworker.0 00010000:00010000:0.0:1788263353.537368:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263353.597080:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753746944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263353.597175:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263353.597335:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753746944 00000100:00100000:2.0:1788263353.597346:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753746944 00000100:00100000:2.0:1788263353.597414:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788263353.597426:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753746944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263353.597475:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263353.597533:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753746944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263353.597541:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788263353.597602:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753746944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263354.113475:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753747072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263354.113570:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.114058:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753747072 00000100:00100000:1.0:1788263354.114069:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753747072 00000100:00100000:1.0:1788263354.114143:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788263354.114155:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753747072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263354.114214:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263354.114298:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753747072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263354.114306:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788263354.114498:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753747072:0@lo:13:osp-pre-0-0.0 00000020:01000004:1.0:1788263354.482857:0:13094:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788263354.503726:0:13094:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788263354.503790:0:13094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.503808:0:13094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.503817:0:13094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.503825:0:13094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.503851:0:13094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788263354.503857:0:13094:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788263354.503887:0:13094:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263354.503893:0:13094:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788263354.503900:0:13094:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788263354.503954:0:13094:0:(import.c:65:import_set_state_nolock()) ffff994346aec000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788263354.503995:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994376151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753747200:0@lo:39:umount.0 00000100:00100000:0.0:1788263354.504077:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263354.504744:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263354.504757:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.504782:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7e00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263354.504786:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.504795:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263354.504802:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263354.504808:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263354.504811:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788263354.504814:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788263354.504851:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.504858:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263354.504883:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.504890:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943810d7e00/0x1a657bc513955b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955b68 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263354.505851:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753747328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263354.505929:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263354.506308:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263354.506312:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263354.506315:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263354.506338:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753747200 00000100:00100000:1.0:1788263354.506349:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753747200 00000100:00100000:1.0:1788263354.506410:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788263354.506423:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875129753747200:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788263354.506484:0:5854:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc5139558dd 00000100:00080000:1.0:1788263354.506495:0:5854:0:(import.c:65:import_set_state_nolock()) ffff994381491000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788263354.506578:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3319:x1875129753747200:12345-0@lo:39:umount.0 Request processed in 157us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263354.506587:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788263354.506600:0:5854:0:(genops.c:885:class_export_put()) final put ffff994381492800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788263354.506815:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263354.506827:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff994381492800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788263354.506884:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994381491000 for lustre-MDT0000 00000100:00080000:0.0:1788263354.508904:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994346aec000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788263354.508926:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994376151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753747200:0@lo:39:umount.0 00000100:00080000:1.0:1788263354.510267:0:13094:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788263354.510277:0:13094:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788263354.510285:0:13094:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788263354.511796:0:13094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511819:0:13094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511828:0:13094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511836:0:13094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511872:0:13094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263354.511879:0:13094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511886:0:13094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511913:0:13094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511920:0:13094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511944:0:13094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788263354.511968:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263354.511976:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511985:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158a00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263354.511989:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.511999:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263354.512008:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263354.512015:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263354.512017:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788263354.512067:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.512074:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263354.512574:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.512596:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158a00/0x1a657bc513955b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955b76 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.512608:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263354.512612:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.512742:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263354.512773:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753747456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263354.512871:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263354.512959:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753747328 00000100:00100000:0.0:1788263354.512969:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753747328 00000100:00100000:0.0:1788263354.513027:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753747456 00000100:00100000:0.0:1788263354.513030:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753747456 00000100:00100000:0.0:1788263354.513052:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263354.513063:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+20:3323:x1875129753747328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263354.513080:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263354.513115:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343159200/0x1a657bc513955b68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955b61 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.513132:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263354.513172:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+19:3323:x1875129753747328:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (7242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263354.513180:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263354.513211:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263354.513239:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376151f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:3320:x1875129753747456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263354.513248:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263354.513258:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d7400/0x1a657bc513955b76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955b6f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.513278:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263354.513307:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376151f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3320:x1875129753747456:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263354.513314:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263354.513359:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753747456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263354.514197:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159800 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263354.514212:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514261:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263354.514269:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263354.514274:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263354.514278:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788263354.514282:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788263354.514321:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514328:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263354.514346:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514354:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343159800/0x1a657bc513955a88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955a8f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514391:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263354.514393:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263354.514396:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263354.514420:0:13094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514429:0:13094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514436:0:13094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514443:0:13094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514457:0:13094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263354.514604:0:13094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514612:0:13094:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514672:0:13094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514679:0:13094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514697:0:13094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788263354.514707:0:13094:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788263354.514711:0:13094:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788263354.514755:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263354.514760:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514767:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658200 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263354.514771:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514778:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263354.514785:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263354.514790:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788263354.514792:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788263354.514794:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788263354.514811:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514816:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263354.514830:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514836:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513955d7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955d83 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514845:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263354.514848:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514863:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216c600 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263354.514866:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514873:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263354.514878:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263354.514883:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263354.514886:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788263354.514888:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788263354.514904:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514910:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263354.514915:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514921:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216c600/0x1a657bc51395583c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263354.514932:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263354.514934:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263354.514935:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263354.514952:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753747712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263354.515018:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.515080:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263354.515227:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263354.515239:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753747584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263354.515270:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263354.515297:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263354.515312:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753747712 00000100:00100000:0.0:1788263354.515319:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753747712 00000100:00100000:0.0:1788263354.515367:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753747584 00000100:00100000:0.0:1788263354.515371:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753747584 00000100:00100000:0.0:1788263354.515395:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263354.515406:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+18:3322:x1875129753747712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263354.515421:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263354.515438:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216d400/0x1a657bc513955d83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955d7c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.515452:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263354.515500:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+17:3322:x1875129753747712:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263354.515508:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263354.515525:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263354.515532:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994376153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+16:3320:x1875129753747584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263354.515539:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263354.515555:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343159400/0x1a657bc513955a8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955a88 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.515568:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263354.515596:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994376153100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:3320:x1875129753747584:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263354.515602:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263354.515659:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753747584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263354.515872:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753747840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263354.515906:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.515946:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753747712:0@lo:103:ldlm_bl.0 00000020:01000004:1.0:1788263354.515979:0:13094:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788263354.515984:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788263354.515991:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263354.515998:0:13094:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1788263354.516003:0:13094:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99437f57b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263354.516010:0:13094:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff994375d83800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263354.516018:0:13094:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff99437cb25800 584ba373-7851-453b-ba8f-f510758f1581 192.168.201.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263354.516023:0:13094:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff994375d85000 fedef325-db54-4469-b29a-301ff58466df 192.168.201.29@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1788263354.516027:0:13094:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9943473eb370) has exports, disconnecting them 00000020:00080000:1.0:1788263354.516032:0:13094:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99437f57b000), last request at 1788263353 00000020:00000080:1.0:1788263354.516040:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955a50 00000100:00080000:1.0:1788263354.516060:0:13094:0:(import.c:65:import_set_state_nolock()) ffff99437f579800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788263354.516573:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788263354.516592:0:13094:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99437f57b000): rc 0 00000020:00000080:1.0:1788263354.516595:0:13094:0:(genops.c:885:class_export_put()) final put ffff99437f57b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788263354.516609:0:13094:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff994375d83800), last request at 1788263353 00000020:00000080:1.0:1788263354.516615:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955977 00000100:00100000:0.0:1788263354.516740:0:8470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753747840 00000100:00100000:0.0:1788263354.516751:0:8470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753747840 00000100:00100000:0.0:1788263354.516796:0:8470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263354.516805:0:8470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+15:3322:x1875129753747840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263354.516817:0:8470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263354.516833:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031400/0x1a657bc513955843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc51395583c expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263354.516848:0:8470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263354.516901:0:8470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33366ce6-2c46-49eb-9afc-8617712bc2f4+14:3322:x1875129753747840:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263354.516907:0:8470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263354.516943:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33366ce6-2c46-49eb-9afc-8617712bc2f4:3322:1875129753747840:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788263354.516991:0:13094:0:(import.c:65:import_set_state_nolock()) ffff994375d84000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788263354.517021:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437f57b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788263354.517071:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99437f579800 for lustre-MDT0000 00010000:00010000:0.0:1788263354.517846:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788263354.518204:0:13094:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994375d83800): rc 0 00000020:00000080:1.0:1788263354.518208:0:13094:0:(genops.c:885:class_export_put()) final put ffff994375d83800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788263354.518249:0:13094:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb13203a97ae0 00000100:00080000:1.0:1788263354.518293:0:13094:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788263354.518298:0:13094:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788263354.518314:0:13094:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788263354.518393:0:13094:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788263354.518423:0:13094:0:(import.c:65:import_set_state_nolock()) ffff9943472d3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788263354.518440:0:13094:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788263354.518442:0:13094:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788263354.519565:0:13094:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:0.0:1788263354.519752:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff994375d83800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1788263354.519854:0:13094:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788263354.519880:0:13094:0:(import.c:65:import_set_state_nolock()) ffff994342fd2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788263354.519921:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9943473eb370) has no exports 00000020:00000080:0.0:1788263354.520264:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994375d84000 for lustre-MDT0000 00000100:00100000:0.0:1788263354.520295:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753747968:0@lo:9:umount.0 00000100:00100000:0.0:1788263354.520387:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263354.520430:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753748096:0@lo:9:umount.0 00000100:00100000:0.0:1788263354.520559:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263354.520612:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753747968 00000100:00100000:0.0:1788263354.520634:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753747968 00000100:00100000:0.0:1788263354.520689:0:8112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753748096 00000100:00100000:0.0:1788263354.520693:0:8112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753748096 00000100:00100000:0.0:1788263354.520719:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788263354.520730:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875129753747968:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788263354.520765:0:8112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc5139559c4 00000100:00080000:0.0:1788263354.520777:0:8112:0:(import.c:65:import_set_state_nolock()) ffff994375d81000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788263354.520819:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788263354.521046:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3319:x1875129753747968:12345-0@lo:9:umount.0 Request processed in 316us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263354.521054:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788263354.521072:0:8112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788263354.521079:0:8112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875129753748096:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788263354.521327:0:8112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955ab9 00000100:00080000:0.0:1788263354.521336:0:8112:0:(import.c:65:import_set_state_nolock()) ffff9942421af800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788263354.521366:0:8112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1788263354.521740:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263354.521856:0:8112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3319:x1875129753748096:12345-0@lo:9:umount.0 Request processed in 775us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263354.521864:0:8112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1788263354.521893:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263354.521933:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9943472d3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788263354.521956:0:3319:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788263354.521959:0:3319:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788263354.521963:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753747968:0@lo:9:umount.0 00000100:00080000:0.0:1788263354.521978:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994342fd2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788263354.521990:0:3319:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788263354.522006:0:3319:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788263354.522009:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753748096:0@lo:9:umount.0 00000100:00100000:3.0:1788263354.524289:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753747328:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788263354.535259:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9943473eb370) has no exports 00010000:00010000:0.0:1788263354.560719:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263354.605942:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955897 00000020:00000080:1.0:1788263354.605960:0:13094:0:(genops.c:885:class_export_put()) final put ffff9943744bc000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788263354.605980:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788263354.606750:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9943744bc000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788263354.606802:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263354.606815:0:13094:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788263354.606821:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9943473c0000) has no exports 00000020:00000080:0.0:1788263354.609475:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955890 00000020:00000080:0.0:1788263354.609495:0:13094:0:(genops.c:885:class_export_put()) final put ffff99437a566800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788263354.609570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437a566800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788263354.609598:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263354.609614:0:13094:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788263354.609741:0:13094:0:(genops.c:885:class_export_put()) final put ffff9943744bb800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788263354.609745:0:13094:0:(genops.c:844:class_export_destroy()) destroying export ffff9943744bb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788263354.609753:0:13094:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:2.0:1788263354.691981:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788263354.691993:0:6729:0:(genops.c:885:class_export_put()) final put ffff994375d86000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788263354.692076:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994375d86000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788263354.692288:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994375d81000 for lustre-OST0000 00000001:00100000:2.0:1788263354.692342:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:2.0:1788263354.692346:0:6729:0:(genops.c:885:class_export_put()) final put ffff99434646d000/fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:1.0:1788263354.692401:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99434646d000/fedef325-db54-4469-b29a-301ff58466df for lustre-OST0000 00000020:00000080:1.0:1788263354.692435:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994346468800 for lustre-OST0000 00000001:00100000:3.0:1788263354.714773:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fedef325-db54-4469-b29a-301ff58466df 00000001:00080000:3.0:1788263354.714790:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:3.0:1788263354.714817:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 584ba373-7851-453b-ba8f-f510758f1581 00000001:00080000:3.0:1788263354.714821:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788263354.714824:0:5874:0:(genops.c:885:class_export_put()) final put ffff99437cb25800/584ba373-7851-453b-ba8f-f510758f1581 00000020:00000080:3.0:1788263354.714839:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff99437cb25800/584ba373-7851-453b-ba8f-f510758f1581 for lustre-MDT0000 00000020:00000080:3.0:1788263354.714886:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99437cb20800 for lustre-MDT0000 00000020:00000080:3.0:1788263354.714909:0:5874:0:(genops.c:885:class_export_put()) final put ffff994375d85000/fedef325-db54-4469-b29a-301ff58466df 00000020:00000080:3.0:1788263354.714932:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994375d85000/fedef325-db54-4469-b29a-301ff58466df for lustre-MDT0000 00000020:00000080:3.0:1788263354.714975:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994346b73000 for lustre-MDT0000 00010000:00010000:0.0:1788263355.581272:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263356.603657:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788263356.667736:0:13094:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994342f11600 - data ffff99436d837af8/ffff994242e1d800 00000020:01000000:0.0:1788263356.667904:0:13094:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99435239de40 - data ffff99436dac7948/ffff9943810c7400 00000001:00000004:0.0:1788263356.676864:0:13094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788263356.837473:0:13094:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788263356.837485:0:13094:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788263356.837512:0:13094:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788263356.837515:0:13094:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788263356.839812:0:6799:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788263356.839824:0:6799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788263356.839844:0:6799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788263356.846590:0:13094:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788263356.846604:0:13094:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788263356.846636:0:13094:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788263356.846640:0:13094:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788263356.847196:0:8110:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788263356.847203:0:8110:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788263356.847249:0:8110:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788263356.969783:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc51395585f 00000020:00000080:0.0:1788263356.969803:0:13094:0:(genops.c:885:class_export_put()) final put ffff9943744da000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788263356.971523:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff9943744da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788263356.972653:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955874 00000020:00000080:0.0:1788263356.972666:0:13094:0:(genops.c:885:class_export_put()) final put ffff994381494800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788263356.972731:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788263356.972739:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263356.972750:0:13094:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788263356.972755:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9943473e99b8) has no exports 00000004:01000000:0.0:1788263356.972960:0:13094:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788263356.972992:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955ab2 00000020:00000080:0.0:1788263356.972997:0:13094:0:(genops.c:885:class_export_put()) final put ffff9943472d5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788263356.973064:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff994381494800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788263356.973209:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788263356.973214:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263356.973250:0:13094:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788263356.973253:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff99437f9c99b8) has no exports 00000020:00000080:0.0:1788263356.973262:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955aab 00000020:00000080:0.0:1788263356.973267:0:13094:0:(genops.c:885:class_export_put()) final put ffff994346b71800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788263356.973329:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff9943472d5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788263356.973825:0:13094:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788263356.973831:0:13094:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788263356.973837:0:13094:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788263356.973844:0:13094:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788263356.973847:0:13094:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788263356.973971:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff994346b71800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788263356.974165:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263356.974175:0:13094:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788263356.974182:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc5139559bd 00000020:00000080:0.0:1788263356.974189:0:13094:0:(genops.c:885:class_export_put()) final put ffff99437fa2c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788263356.974210:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994342fd2000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788263356.974290:0:492:0:(genops.c:885:class_export_put()) final put ffff99437cb21800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788263356.974293:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff99437cb21800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788263356.974298:0:492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788263356.974542:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788263356.974554:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263356.974560:0:13094:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788263356.974565:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff99434643b370) has no exports 00000020:00000080:0.0:1788263356.974571:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc5139559b6 00000020:00000080:0.0:1788263356.974576:0:13094:0:(genops.c:885:class_export_put()) final put ffff9943472d1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788263356.974598:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fa2c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1788263356.975186:0:13094:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788263356.975192:0:13094:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788263356.975196:0:13094:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788263356.975203:0:13094:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788263356.975206:0:13094:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788263356.979391:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff9943472d1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788263356.979659:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263356.979678:0:13094:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788263356.979718:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263356.979721:0:13094:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788263356.979748:0:13094:0:(genops.c:885:class_export_put()) final put ffff9943744df800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788263356.979751:0:13094:0:(genops.c:844:class_export_destroy()) destroying export ffff9943744df800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788263356.979763:0:13094:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788263356.979955:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc51395587b 00000020:00000080:0.0:1788263356.979963:0:13094:0:(genops.c:885:class_export_put()) final put ffff994381493000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788263356.979969:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788263356.979974:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263356.979980:0:13094:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788263356.979985:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9943473e8000) has no exports 00000020:00000080:0.0:1788263356.980009:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263356.980012:0:13094:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788263356.980017:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955882 00000020:00000080:0.0:1788263356.980021:0:13094:0:(genops.c:885:class_export_put()) final put ffff994381491800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788263356.980031:0:13094:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994350979800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788263356.980035:0:13094:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994350979800 3 00000020:01000004:0.0:1788263356.980038:0:13094:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994350979800 from lustre-MDT0000 00000020:00000080:1.0:1788263356.980154:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943472d3000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788263356.980162:0:492:0:(genops.c:885:class_export_put()) final put ffff994346b70000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788263356.980164:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff994346b70000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788263356.980170:0:492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788263356.980299:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff994381493000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788263356.980304:0:492:0:(genops.c:885:class_export_put()) final put ffff994381495800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788263356.980306:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff994381495800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788263356.980309:0:492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788263356.980564:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff994381491800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788263356.980651:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263356.980658:0:13094:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788263356.980661:0:13094:0:(genops.c:885:class_export_put()) final put ffff9943744dc800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788263356.980664:0:13094:0:(genops.c:844:class_export_destroy()) destroying export ffff9943744dc800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788263356.980674:0:13094:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788263356.980704:0:13094:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788263356.980709:0:13094:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788263356.980713:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788263356.980715:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263356.980718:0:13094:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788263356.980727:0:13094:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff99434659c800 33366ce6-2c46-49eb-9afc-8617712bc2f4 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263356.980732:0:13094:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff994346b34d28) has exports, disconnecting them 00000020:00080000:0.0:1788263356.980737:0:13094:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99434659c800), last request at 1788263147 00000020:00000080:0.0:1788263356.980755:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955820 00000020:00010000:0.0:1788263356.980761:0:13094:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99434659c800: total 0 00000100:00080000:0.0:1788263356.980777:0:13094:0:(import.c:65:import_set_state_nolock()) ffff99434659a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788263356.980795:0:13094:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99434659c800): rc 0 00000020:00080000:0.0:1788263356.980802:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff994346b34d28) has no exports 00000100:00100000:0.0:1788263356.980885:0:5847:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9943438bea00:5847] 2 exiting: rc = 0 00000020:00010000:1.0:1788263356.981179:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99434659c800: total 0 00010000:00010000:1.0:1788263356.981209:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99434659c800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788263356.981275:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d7a00/0x1a657bc513955b4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955b45 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263356.981297:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d6800/0x1a657bc513955b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955b37 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263356.981309:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380658000/0x1a657bc513955d67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955d60 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263356.981320:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216c200/0x1a657bc513955d75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955d6e expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263356.981336:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031000/0x1a657bc513955b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955b53 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263356.981357:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994340031800/0x1a657bc51395592a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955923 expref: 4 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263356.981371:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d7200/0x1a657bc513955b84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955b7d expref: 3 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263356.981382:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343159000/0x1a657bc513955b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513955b29 expref: 2 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263356.981393:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99434659c800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788263356.981407:0:5841:0:(genops.c:885:class_export_put()) final put ffff99434659c800/33366ce6-2c46-49eb-9afc-8617712bc2f4 00010000:00010000:1.0:1788263356.981493:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263356.981496:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263356.981498:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263356.981506:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff99434659c800/33366ce6-2c46-49eb-9afc-8617712bc2f4 for MGS 00000020:00000080:1.0:1788263356.981537:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99434659a000 for MGS 00000100:00100000:0.0:1788263356.981674:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9943503dfe00:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1788263356.982046:0:5846:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9943438bfa00:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1788263356.982181:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982195:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982203:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982213:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982497:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982507:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982560:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982573:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982581:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982589:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982600:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982608:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982617:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982627:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982636:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982647:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982656:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982665:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982673:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982681:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982690:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982697:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982705:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982714:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982723:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982732:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982741:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982751:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982764:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982787:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982796:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982848:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982858:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982866:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982875:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982883:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982891:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982900:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982907:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982915:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982922:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982930:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982937:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982944:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982951:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982960:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982968:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982975:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982985:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.982995:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983004:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983013:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983024:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983034:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983061:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983071:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983187:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983199:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983210:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983313:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983324:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983332:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983340:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263356.983353:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788263356.984095:0:13094:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788263356.984100:0:13094:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788263356.985598:0:13094:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99435bcd3600 - data ffff99437ffb45e8/ffff99437603b400 00000020:01000000:1.0:1788263356.985752:0:13094:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99435092f9c0 - data ffff994366fe0798/ffff994350920400 00000020:00000080:1.0:1788263356.986607:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955804 00000020:00000080:1.0:1788263356.986618:0:13094:0:(genops.c:885:class_export_put()) final put ffff99435bcae000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788263356.986678:0:13094:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994350979800 from MGS, refs=2 00000020:01000004:1.0:1788263356.986683:0:13094:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994350979800 2 00000020:01000004:1.0:1788263356.986687:0:13094:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994350979800 from MGS 00000020:00000080:1.0:1788263356.986716:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263356.986723:0:13094:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788263356.986727:0:13094:0:(genops.c:885:class_export_put()) final put ffff99435bca8800/MGS 00000020:00000080:1.0:1788263356.986730:0:13094:0:(genops.c:844:class_export_destroy()) destroying export ffff99435bca8800/MGS for MGS 00000020:01000000:1.0:1788263356.986740:0:13094:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788263356.986831:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788263356.986836:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263356.986844:0:13094:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788263356.986854:0:13094:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff994346aef800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263356.986861:0:13094:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9943473c4d28) has exports, disconnecting them 00000020:00080000:1.0:1788263356.986868:0:13094:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff994346aef800), last request at 1788263148 00000020:00000080:1.0:1788263356.986873:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc5139558cf 00000020:00080000:1.0:1788263356.986884:0:13094:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994346aef800): rc 0 00000020:00000080:1.0:1788263356.986897:0:13094:0:(genops.c:885:class_export_put()) final put ffff994346aef800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788263356.986966:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99435bcae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788263356.988124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994346aef800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788263356.988332:0:13094:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788263356.988339:0:13094:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263356.988345:0:13094:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788263356.988353:0:13094:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788263356.988799:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263356.988808:0:13094:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788263356.988816:0:13094:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994350979800 1 00000020:00000080:0.0:1788263356.988823:0:13094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc5139557f6 00000020:00000080:0.0:1788263356.988831:0:13094:0:(genops.c:885:class_export_put()) final put ffff99435bcad000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788263356.988869:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994346aec000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788263356.988878:0:8:0:(genops.c:885:class_export_put()) final put ffff99437a563000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788263356.988895:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437a563000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788263356.988908:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1788263356.989068:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788263356.989075:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263356.989079:0:13094:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788263356.989084:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff994349ce19b8) has no exports 00000020:00000080:2.0:1788263356.989268:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99435bcad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788263357.061560:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263357.061652:0:13094:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788263357.061659:0:13094:0:(genops.c:885:class_export_put()) final put ffff99435097a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788263357.061665:0:13094:0:(genops.c:844:class_export_destroy()) destroying export ffff99435097a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788263357.061674:0:13094:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788263357.061835:0:13094:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99435097c800 00000020:01000000:2.0:1788263357.061861:0:13094:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788263357.061866:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263357.061871:0:13094:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788263357.061875:0:13094:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9943473ecd28) has no exports 00000100:00100000:0.0:1788263357.062293:0:5853:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff994346339600:5853] 1 exiting: rc = 0 00000100:00100000:1.0:1788263357.064112:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9943473cfa00:5852] 0 exiting: rc = 1 00000100:00100000:1.0:1788263357.064385:0:5854:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9943438be400:5854] 2 exiting: rc = 0 00000100:00100000:1.0:1788263357.064543:0:6725:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff99437fa21400:6725] 3 exiting: rc = 0 00000100:00100000:0.0:1788263357.068284:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068298:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068305:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068311:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068318:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068324:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068333:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068341:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068347:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068354:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068361:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068368:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068374:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068381:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068387:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068394:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068400:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068571:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068585:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068592:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068598:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068604:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068610:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068616:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068622:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068628:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068634:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068640:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068647:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068653:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068659:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068665:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068671:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068677:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068683:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068688:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068694:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068699:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068705:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068710:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068717:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068723:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068730:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068736:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068742:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068748:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068756:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068761:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068766:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068772:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068778:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068784:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068795:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068801:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068807:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068813:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068819:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068826:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068832:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068838:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068844:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068850:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068856:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.068862:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.080096:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff994346339e00:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1788263357.083487:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff994346339a00:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1788263357.083677:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083690:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083697:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083705:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083712:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083718:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083725:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083732:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083739:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083745:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083752:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083759:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083766:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083772:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083778:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083783:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083788:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083795:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083801:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083807:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083812:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083818:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083823:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083846:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083851:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083857:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083862:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083868:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083875:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083881:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083887:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083892:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083898:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083904:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083912:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083918:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083924:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083929:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083935:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083940:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083945:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083950:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083956:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083962:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083967:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083972:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083978:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083983:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083989:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.083995:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084001:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084007:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084013:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084018:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084023:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084029:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084034:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084051:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084066:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084071:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084077:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084083:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084091:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.084097:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.085655:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99434f11c000:5858] 1 exiting: rc = 0 00000100:00100000:3.0:1788263357.088590:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff994346203c00:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1788263357.089013:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089022:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089030:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089036:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089042:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089049:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089065:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089072:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089079:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089086:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089092:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089098:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089104:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089111:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089118:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089124:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089130:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089137:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089173:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089181:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089187:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089194:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089200:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089207:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089213:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089250:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089256:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089262:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089282:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089288:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089308:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089316:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089322:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089328:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089335:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089342:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089349:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089355:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089362:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089369:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089375:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089382:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089404:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089412:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089430:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089437:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089443:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089449:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089456:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089461:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089467:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089476:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089482:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089488:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089508:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089516:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089523:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089529:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089535:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089541:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089547:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089553:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089561:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.089577:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.113771:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff994346203200:5859] 0 exiting: rc = 1 00000100:00100000:0.0:1788263357.113934:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff994346202200:5860] 1 exiting: rc = 0 00000100:00100000:0.0:1788263357.114005:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114014:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114020:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114027:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114033:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114104:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114114:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114120:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114126:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114132:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114147:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114154:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114159:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114166:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114171:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114177:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114183:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114188:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114194:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114199:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114204:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114210:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114244:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114251:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114257:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114262:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114267:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114272:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114278:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114283:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114288:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114293:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114298:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114324:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114330:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114336:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114342:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114347:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114352:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114358:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114363:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114369:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114374:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114379:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114385:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114390:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114396:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114402:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.114408:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115173:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115191:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115197:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115204:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115210:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115273:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115281:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115287:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115294:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115300:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115305:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115311:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115316:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115322:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.115328:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.117514:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff994346332800:5862] 1 exiting: rc = 0 00000100:00100000:0.0:1788263357.121888:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff994346202800:5861] 0 exiting: rc = 1 00000100:00100000:2.0:1788263357.122627:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122638:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122644:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122650:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122656:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122662:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122668:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122673:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122679:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122685:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122690:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122695:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122701:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122706:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122711:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122717:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122742:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122748:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122753:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122759:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122764:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122769:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122775:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122780:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122785:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122790:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122821:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122827:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122831:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122837:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122842:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122848:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122853:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122858:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122864:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122870:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122901:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122907:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122912:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122917:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122923:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122929:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122934:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122939:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122943:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122948:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122954:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122959:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122964:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122969:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122975:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122989:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.122995:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123000:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123005:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123010:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123016:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123022:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123027:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123033:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123638:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123655:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123660:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.123665:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263357.125957:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff994372109200:5863] 0 exiting: rc = 1 00000100:00100000:2.0:1788263357.126270:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff994346339c00:5864] 1 exiting: rc = 0 00000100:00100000:2.0:1788263357.126347:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126355:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126362:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126367:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126374:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126380:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126386:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126391:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126396:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126401:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126407:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126413:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126652:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126660:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126667:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126674:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126681:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126687:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126696:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126704:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126714:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126744:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126754:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126764:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126772:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126777:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126782:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126785:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126791:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126802:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126879:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126884:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126889:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126894:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126900:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126906:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126912:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126917:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126922:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126927:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126933:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126938:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126944:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126950:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126956:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126962:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126968:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126973:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126979:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126985:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126991:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.126997:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127002:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127007:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127012:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127018:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127031:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127037:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127111:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127118:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127124:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127129:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127135:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.127151:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.128351:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9943465c5800:5866] 1 exiting: rc = 0 00000100:00100000:2.0:1788263357.131562:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff994346312600:5867] 2 exiting: rc = 0 00000100:00100000:3.0:1788263357.134977:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff994346313600:5865] 0 exiting: rc = 1 00000100:00100000:2.0:1788263357.135125:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135151:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135161:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135170:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135179:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135188:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135197:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135206:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135242:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135252:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135260:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135268:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135277:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135286:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135295:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135304:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135313:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135319:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135328:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135340:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135370:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135384:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135390:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135402:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135560:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135655:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135662:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135668:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135674:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135680:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135686:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135692:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135699:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135705:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135711:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135717:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135728:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135736:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135743:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135749:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135755:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135763:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135769:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135776:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135798:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135806:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135812:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135818:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135826:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135832:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135838:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135844:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135851:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135858:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135864:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135871:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135877:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135883:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135890:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135897:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135910:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135916:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135922:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263357.135936:0:13094:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788263357.147328:0:13094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263357.147344:0:13094:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788263357.147350:0:13094:0:(genops.c:885:class_export_put()) final put ffff994372115800/MDS_uuid 00000020:00000080:2.0:1788263357.147355:0:13094:0:(genops.c:844:class_export_destroy()) destroying export ffff994372115800/MDS_uuid for MDS 00000020:01000000:2.0:1788263357.147364:0:13094:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788263357.147742:0:13094:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788263357.630014:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788263357.742517:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788263357.742531:0:7662:0:(genops.c:885:class_export_put()) final put ffff9942421ad800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788263357.742755:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942421ad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788263357.742822:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942421af800 for lustre-OST0001 00000100:00100000:2.0:1788263358.213189:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753748224:0@lo:400:kworker.0 00000400:00000100:2.0:1788263358.213288:0:3320:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875129753748224 offset 0 length 224: 4 00000100:00100000:3.0:1788263358.213486:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753748352:0@lo:400:kworker.0 00000400:00000100:3.0:1788263358.213517:0:3321:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753748352 offset 0 length 224: 4 00000100:00100000:0.0:1788263358.219318:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753748480:0@lo:400:kworker.0 00000400:00000100:0.0:1788263358.219397:0:3322:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753748480 offset 0 length 224: 4 00010000:00010000:3.0:1788263358.656934:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263359.676134:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263360.665664:0:13248:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788263360.700618:0:13248:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788263360.700691:0:13248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263360.700710:0:13248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263360.700718:0:13248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263360.700725:0:13248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263360.700750:0:13248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788263360.700756:0:13248:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788263360.700782:0:13248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788263360.700814:0:13248:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994347205f80 x1875129753748352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788263360.700877:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263360.700887:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263360.700896:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158e00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263360.700900:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263360.700910:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263360.700918:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263360.700922:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788263360.700925:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263360.700927:0:5840:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788263360.700930:0:5840:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788263360.700998:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263360.701017:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263360.701050:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263360.701057:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513955b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513955b4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263360.701071:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263360.701073:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263360.701075:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263360.701097:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753748608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263360.701198:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263360.701345:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753748608 00000100:00100000:2.0:1788263360.701355:0:8471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753748608 00000100:00100000:2.0:1788263360.701415:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263360.701425:0:8471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3323:x1875129753748608:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788263360.701432:0:8471:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788263360 with bad export cookie 1902062504001230880 00000100:00100000:1.0:1788263360.704622:0:13248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788263360.704643:0:13248:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788263360.704686:0:13248:0:(import.c:65:import_set_state_nolock()) ffff99437fa2f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788263360.704908:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753748736:0@lo:39:umount.0 00000400:00000100:0.0:1788263360.704996:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753748736 offset 0 length 224: 4 00000100:00100000:3.0:1788263360.705276:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753748352:0@lo:400:kworker.0 00000100:00100000:2.0:1788263360.718734:0:8471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3323:x1875129753748608:12345-0@lo:103:ldlm_bl.0 Request processed in 17297us (17524us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788263360.718764:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788263360.719311:0:3323:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788263360.719319:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9943465ac000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788263360.719324:0:3323:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788263360.735244:0:3323:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.129@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788263360.735253:0:3323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788263360.735266:0:3323:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994347205500 x1875129753748224/t0(0) o400->MGC192.168.201.129@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788263374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263360.735295:0:3323:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9943810d8a80 x1875129753748608/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788263376 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788263360.735307:0:3323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788263360.735310:0:3323:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788263360.735312:0:3323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788263360.735317:0:3323:0:(import.c:65:import_set_state_nolock()) ffff9943465ac000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788263360.735323:0:3323:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 174 00000100:00080000:0.0:1788263360.735334:0:3323:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9943465ac000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263360.735578:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33366ce6-2c46-49eb-9afc-8617712bc2f4:3320:1875129753748224:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.735738:0:3323:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994347206a00 x1875129753748864/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263360.735805:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33366ce6-2c46-49eb-9afc-8617712bc2f4:3319:1875129753748864:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788263360.735866:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875129753748864 offset 0 length 520: 4 00000100:00100000:0.0:1788263360.735940:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33366ce6-2c46-49eb-9afc-8617712bc2f4:3323:1875129753748608:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788263361.276555:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788263361.276568:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788263361.276754:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753748992:0@lo:400:kworker.0 00000400:00000100:1.0:1788263361.276835:0:3320:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753748992 offset 0 length 224: 4 00010000:00010000:0.0:1788263361.724182:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263362.747598:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263363.773123:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263364.795476:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263365.307586:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788263365.307598:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788263365.307722:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263365.307743:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753749120:0@lo:400:kworker.0 00000400:00000100:1.0:1788263365.307820:0:3320:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753749120 offset 0 length 224: 4 00010000:00010000:0.0:1788263365.819483:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263366.843474:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263367.868368:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263368.891427:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263369.916005:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263370.491675:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788263370.491686:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788263370.492434:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263370.492459:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753749248:0@lo:400:kworker.0 00000400:00000100:3.0:1788263370.492726:0:3323:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753749248 offset 0 length 224: 4 00010000:00010000:2.0:1788263370.939381:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263371.003388:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263360/real 1788263360] req@ffff994347206a00 x1875129753748864/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788263370 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263371.003424:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994347206a00 x1875129753748864/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788263370 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263371.003435:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263360/real 1788263360] req@ffff99437f50aa00 x1875129753748736/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263370 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263371.003447:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99437f50aa00 x1875129753748736/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263370 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788263371.003464:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9943465ac000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263371.003492:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788263371.003496:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33366ce6-2c46-49eb-9afc-8617712bc2f4:3319:1875129753748864:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788263371.003502:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437fa2f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788263371.003521:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753748736:0@lo:39:umount.0 00000100:00080000:1.0:1788263371.003702:0:13248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788263371.003707:0:13248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788263371.003713:0:13248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788263371.004566:0:13248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263371.004581:0:13248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263371.004588:0:13248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263371.004595:0:13248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263371.004624:0:13248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263371.004646:0:13248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263371.004653:0:13248:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263371.004659:0:13248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263371.004665:0:13248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263371.004686:0:13248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788263371.004691:0:13248:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788263371.004713:0:13248:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788263371.004717:0:13248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788263371.004722:0:13248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263371.004728:0:13248:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788263371.004733:0:13248:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff994346b319b8) has no exports 00000020:00080000:1.0:1788263371.004762:0:13248:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff994346b319b8) has no exports 00000020:01000000:1.0:1788263371.006381:0:13248:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994342f116c0 - data ffff994366fb05e8/ffff9942420f7400 00000020:01000000:1.0:1788263371.006506:0:13248:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994372333a20 - data ffff994241502948/ffff99437f6d7400 00000100:00080000:0.0:1788263371.007546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788263371.007553:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788263371.007557:0:8:0:(import.c:65:import_set_state_nolock()) ffff9943465ac000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788263371.007563:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 387 00000100:00080000:0.0:1788263371.007569:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788263371.007576:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9943465ac000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788263371.007608:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994347204a80 x1875129753749376/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788263371.007707:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263371.007716:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263371.007726:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158200 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:3.0:1788263371.007731:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263371.007741:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263371.007759:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263371.007764:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788263371.007767:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788263371.007770:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788263371.007785:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9943465ac000 00010000:00010000:3.0:1788263371.007788:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263371.007795:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc513955b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955b5a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263371.007808:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263371.007811:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263371.007817:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6600 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:3.0:1788263371.007820:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263371.007825:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263371.007831:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263371.007835:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788263371.007837:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788263371.007847:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788263371.007854:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9943465ac000 00010000:00010000:3.0:1788263371.007857:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263371.007862:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513955d6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955d75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263371.007871:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263371.007872:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263371.007874:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263371.008485:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263371.011561:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33366ce6-2c46-49eb-9afc-8617712bc2f4:3319:1875129753749376:0@lo:250:kworker.0 00000400:00000100:1.0:1788263371.011626:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875129753749376 offset 0 length 520: 4 00100000:10000000:1.0:1788263371.019683:0:13248:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788263371.046073:0:13248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955946 00000020:00000080:0.0:1788263371.046084:0:13248:0:(genops.c:885:class_export_put()) final put ffff99437f777800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788263371.046098:0:13248:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99438144e800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788263371.046101:0:13248:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99438144e800 2 00000020:01000004:0.0:1788263371.046104:0:13248:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99438144e800 from lustre-OST0000 00000020:00000080:2.0:1788263371.046505:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437f777800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788263371.046890:0:13248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263371.046912:0:13248:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788263371.046916:0:13248:0:(genops.c:885:class_export_put()) final put ffff99437cb25000/lustre-OST0000_UUID 00000020:00000080:0.0:1788263371.046919:0:13248:0:(genops.c:844:class_export_destroy()) destroying export ffff99437cb25000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788263371.046926:0:13248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788263371.046972:0:13248:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788263371.046976:0:13248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788263371.046986:0:13248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263371.046992:0:13248:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788263371.046999:0:13248:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99437fa28800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263371.047006:0:13248:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9943473c19b8) has exports, disconnecting them 00000020:00080000:0.0:1788263371.047012:0:13248:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99437fa28800), last request at 1788263163 00000020:00000080:0.0:1788263371.047016:0:13248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955970 00000020:00080000:0.0:1788263371.047028:0:13248:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99437fa28800): rc 0 00000020:00000080:0.0:1788263371.047032:0:13248:0:(genops.c:885:class_export_put()) final put ffff99437fa28800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788263371.051452:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fa28800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788263371.056329:0:13248:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788263371.056339:0:13248:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788263371.056344:0:13248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788263371.056352:0:13248:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788263371.056543:0:13248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263371.056554:0:13248:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788263371.056560:0:13248:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99438144e800 1 00000020:00000080:2.0:1788263371.056567:0:13248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955900 00000020:00000080:2.0:1788263371.056577:0:13248:0:(genops.c:885:class_export_put()) final put ffff994346b70800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788263371.056582:0:13248:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788263371.056590:0:13248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263371.056594:0:13248:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788263371.056598:0:13248:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff994349ce3370) has no exports 00000020:00000080:3.0:1788263371.056665:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99437fa2f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788263371.056674:0:8:0:(genops.c:885:class_export_put()) final put ffff994346af3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788263371.056678:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994346af3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788263371.056688:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788263371.056747:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994346b70800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788263371.117984:0:13248:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263371.118002:0:13248:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788263371.118008:0:13248:0:(genops.c:885:class_export_put()) final put ffff9943457c7800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788263371.118013:0:13248:0:(genops.c:844:class_export_destroy()) destroying export ffff9943457c7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788263371.118025:0:13248:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788263371.118199:0:13248:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff994346305000 00000020:02000400:2.0:1788263371.118286:0:13248:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788263371.964391:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263372.987371:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788263373.489398:0:13400:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788263373.507100:0:13400:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788263373.507178:0:13400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263373.507192:0:13400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263373.507200:0:13400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263373.507207:0:13400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263373.507260:0:13400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788263373.507316:0:13400:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788263373.507338:0:13400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263373.507350:0:13400:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994347207b80 x1875129753748480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263373.507367:0:13400:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99437630ca80 x1875129753748992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263377 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263373.507386:0:13400:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994347206680 x1875129753749120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263373.507395:0:13400:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994347205c00 x1875129753749248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263373.507406:0:13400:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788263373.507412:0:13400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788263373.507436:0:13400:0:(import.c:65:import_set_state_nolock()) ffff9942421a9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788263373.507543:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263373.507550:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263373.507558:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030c00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263373.507562:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263373.507571:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263373.507579:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263373.507585:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788263373.507587:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788263373.507590:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788263373.507605:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9943465ac000 00010000:00010000:0.0:1788263373.507609:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263373.507614:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513955b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955b30 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263373.507635:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263373.507636:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263373.507638:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263373.507665:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347207b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753748480:0@lo:400:kworker.0 00000100:00100000:1.0:1788263373.508164:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753749120:0@lo:400:kworker.0 00000100:00100000:1.0:1788263373.508174:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1875129753748992:0@lo:400:kworker.0 00000100:00100000:1.0:1788263373.508202:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347205c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788263373.508369:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753749504:0@lo:39:umount.0 00000400:00000100:2.0:1788263373.508426:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753749504 offset 0 length 224: 4 00010000:00010000:2.0:1788263374.011933:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263375.035911:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263376.059445:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263376.123339:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788263376.123350:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788263377.083825:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263378.107379:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263379.131470:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263380.155855:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263381.179866:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263381.243952:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788263381.243963:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788263382.204441:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263383.231560:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263383.739523:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263373/real 1788263373] req@ffff99437630c700 x1875129753749504/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263383 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263383.739556:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99437630c700 x1875129753749504/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263383 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788263383.739583:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9942421a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788263383.739604:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753749504:0@lo:39:umount.0 00000100:00080000:3.0:1788263383.740300:0:13400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263383.740306:0:13400:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788263383.740312:0:13400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788263383.741141:0:13400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263383.741157:0:13400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263383.741164:0:13400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263383.741171:0:13400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263383.742585:0:13400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263383.742597:0:13400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263383.742606:0:13400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263383.742613:0:13400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263383.742620:0:13400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263383.742704:0:13400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788263383.742712:0:13400:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788263383.742741:0:13400:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788263383.742749:0:13400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788263383.742755:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263383.742762:0:13400:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788263383.742767:0:13400:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99434643cd28) has no exports 00000020:00080000:3.0:1788263383.742792:0:13400:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99434643cd28) has no exports 00000020:01000000:3.0:1788263383.747989:0:13400:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994342f11180 - data ffff99436d815870/ffff99437f9d5c00 00000020:01000000:3.0:1788263383.748114:0:13400:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99437fc97de0 - data ffff99437ff7c438/ffff99424117c000 00010000:00010000:0.0:1788263383.749335:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263383.749498:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263383.749509:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030800 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263383.749513:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263383.749524:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263383.749532:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263383.749537:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788263383.749540:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788263383.749560:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788263383.749580:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9943465ac000 00010000:00010000:0.0:1788263383.749584:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263383.749590:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994340030800/0x1a657bc513955b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955b3e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263383.749604:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263383.749608:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263383.749613:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6400 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263383.749616:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263383.749622:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263383.749628:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263383.749632:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788263383.749634:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788263383.749636:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788263383.749640:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9943465ac000 00010000:00010000:0.0:1788263383.749643:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263383.749649:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943810d6400/0x1a657bc513955d60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955d67 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263383.749673:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263383.749684:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263383.749686:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263383.749978:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788263383.759894:0:13400:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788263383.788765:0:13400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955a1f 00000020:00000080:0.0:1788263383.788778:0:13400:0:(genops.c:885:class_export_put()) final put ffff99434647a800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788263383.788796:0:13400:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994375782000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788263383.788800:0:13400:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994375782000 2 00000020:01000004:0.0:1788263383.788803:0:13400:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994375782000 from lustre-OST0001 00000020:00000080:0.0:1788263383.788827:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263383.788838:0:13400:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788263383.788842:0:13400:0:(genops.c:885:class_export_put()) final put ffff99434647c000/lustre-OST0001_UUID 00000020:00000080:0.0:1788263383.788845:0:13400:0:(genops.c:844:class_export_destroy()) destroying export ffff99434647c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788263383.788853:0:13400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788263383.788955:0:13400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 33366ce6-2c46-49eb-9afc-8617712bc2f4->MGS 00010000:00010000:0.0:1788263383.788971:0:13400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943821f5800/0x1a657bc513955923 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc51395592a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263383.788983:0:13400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943821f5800/0x1a657bc513955923 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc51395592a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263383.788990:0:13400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788263383.788992:0:13400:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788263383.788996:0:13400:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788263383.789010:0:13400:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9943465ac000 00010000:00010000:0.0:1788263383.789014:0:13400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943821f5800/0x1a657bc513955923 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc51395592a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263383.789028:0:13400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513955b84 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263383.789050:0:13400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513955b84 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263383.789055:0:13400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788263383.789058:0:13400:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788263383.789059:0:13400:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788263383.789070:0:13400:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9943465ac000 00010000:00010000:0.0:1788263383.789072:0:13400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc513955b7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513955b84 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788263383.789089:0:13400:0:(import.c:65:import_set_state_nolock()) ffff9943465ac000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788263383.789093:0:13400:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788263383.789096:0:13400:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788263383.789097:0:13400:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788263383.789100:0:13400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788263383.789110:0:13400:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994347204a80 x1875129753749376/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788263386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788263383.789133:0:13400:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788263383.789136:0:13400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1788263383.789271:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33366ce6-2c46-49eb-9afc-8617712bc2f4:3319:1875129753749376:0@lo:250:kworker.0 00000020:00000080:1.0:1788263383.789352:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99434647a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1788263383.790043:0:13400:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788263383.790051:0:13400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955812 00000020:00000080:0.0:1788263383.790057:0:13400:0:(genops.c:885:class_export_put()) final put ffff994372110800/33366ce6-2c46-49eb-9afc-8617712bc2f4 00000020:01000000:0.0:1788263383.790065:0:13400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.129@tcp (flags='') 00000020:00000080:0.0:1788263383.790070:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263383.790075:0:13400:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788263383.790079:0:13400:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9943473c3370) has no exports 10000000:01000000:2.0:1788263383.790144:0:5849:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788263383.790251:0:13400:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.129@tcp: client import never connected 00000100:00080000:0.0:1788263383.790254:0:13400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788263383.790256:0:13400:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788263383.790259:0:13400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788263383.790267:0:13400:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788263383.790301:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263383.790306:0:13400:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.129@tcp (uuid 33366ce6-2c46-49eb-9afc-8617712bc2f4) 00000020:01000000:0.0:1788263383.790310:0:13400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788263383.790313:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263383.790316:0:13400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788263383.790322:0:13400:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9942421af000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263383.790327:0:13400:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9942421b19b8) has exports, disconnecting them 00000020:00080000:0.0:1788263383.790332:0:13400:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9942421af000), last request at 1788263180 00000020:00000080:0.0:1788263383.790336:0:13400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513955a49 00000020:00080000:0.0:1788263383.790360:0:13400:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9942421af000): rc 0 00000020:00000080:0.0:1788263383.790364:0:13400:0:(genops.c:885:class_export_put()) final put ffff9942421af000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788263383.791411:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994372110800/33366ce6-2c46-49eb-9afc-8617712bc2f4 for MGC192.168.201.129@tcp 00000020:00000080:1.0:1788263383.791424:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943465ac000 for MGC192.168.201.129@tcp 00000020:00000080:1.0:1788263383.791430:0:8:0:(genops.c:885:class_export_put()) final put ffff9943465a8000/33366ce6-2c46-49eb-9afc-8617712bc2f4 00000020:00000080:1.0:1788263383.791432:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9943465a8000/33366ce6-2c46-49eb-9afc-8617712bc2f4 for MGC192.168.201.129@tcp 00000020:01000000:1.0:1788263383.791437:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.129@tcp (33366ce6-2c46-49eb-9afc-8617712bc2f4) 00000020:00000080:1.0:1788263383.791913:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942421af000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788263383.792300:0:13400:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788263383.792305:0:13400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788263383.792309:0:13400:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788263383.792314:0:13400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788263383.792381:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788263383.792500:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:2.0:1788263383.792565:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942421a9000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:2.0:1788263383.792894:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99437231f800:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1788263383.794632:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99436dc95000:5835] 0 exiting: rc = 1 00000100:00100000:1.0:1788263383.794801:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263383.795034:0:8470:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9943812c6400:8470] 3 exiting: rc = 0 00000100:00100000:1.0:1788263383.796731:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99436dc95600:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1788263383.798074:0:8471:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff994349eca000:8471] 4 exiting: rc = 0 00000100:00100000:2.0:1788263383.800900:0:5839:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99436dc95e00:5839] 2 exiting: rc = 0 00000100:00100000:1.0:1788263383.801471:0:5838:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99436dc94600:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1788263383.801570:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801591:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801598:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801605:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801611:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801617:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801623:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801630:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801635:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801648:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801655:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801661:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801667:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801695:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801701:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801708:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801714:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801719:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801725:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801731:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801736:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801741:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801746:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801753:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801757:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801762:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801768:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801773:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801777:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801782:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801788:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801793:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801799:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801804:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801810:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801816:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801827:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801833:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801839:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801847:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801852:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801857:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801862:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801867:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801872:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801877:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801883:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801888:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801902:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801908:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801913:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801919:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801925:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801931:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801936:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801943:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801949:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801955:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801960:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801966:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801972:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801978:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801983:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.801989:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788263383.803025:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263383.803036:0:13400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788263383.803042:0:13400:0:(genops.c:885:class_export_put()) final put ffff99434647d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788263383.803046:0:13400:0:(genops.c:844:class_export_destroy()) destroying export ffff99434647d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788263383.803054:0:13400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788263383.803101:0:13400:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994375782000 1 00000020:00000080:2.0:1788263383.803107:0:13400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc5139559ee 00000020:00000080:2.0:1788263383.803114:0:13400:0:(genops.c:885:class_export_put()) final put ffff99437f773800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788263383.803133:0:13400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788263383.803137:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263383.803142:0:13400:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788263383.803147:0:13400:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff994346438000) has no exports 00000020:00000080:1.0:1788263383.803472:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437f773800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788263383.904298:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263383.904316:0:13400:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788263383.904323:0:13400:0:(genops.c:885:class_export_put()) final put ffff994375783000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788263383.904327:0:13400:0:(genops.c:844:class_export_destroy()) destroying export ffff994375783000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788263383.904342:0:13400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788263383.904533:0:13400:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff994375781000 00000020:01000000:1.0:1788263383.904556:0:13400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788263383.904560:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263383.904565:0:13400:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788263383.904568:0:13400:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9943464399b8) has no exports 00000020:00000080:1.0:1788263383.904608:0:13400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263383.904631:0:13400:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788263383.904634:0:13400:0:(genops.c:885:class_export_put()) final put ffff994346b72000/OSS_uuid 00000020:00000080:1.0:1788263383.904637:0:13400:0:(genops.c:844:class_export_destroy()) destroying export ffff994346b72000/OSS_uuid for OSS 00000020:01000000:1.0:1788263383.904644:0:13400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788263383.904724:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99437a58d000:6702] 0 exiting: rc = 1 00000100:00080000:3.0:1788263383.910548:0:5848:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788263383.917357:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff994347c41a00:6704] 1 exiting: rc = 0 00000100:00100000:1.0:1788263383.917449:0:8112:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff99435bf19c00:8112] 3 exiting: rc = 0 00000100:00100000:2.0:1788263383.935393:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff994347c41800:6705] 2 exiting: rc = 0 00000100:00100000:2.0:1788263383.935503:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935511:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935518:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935525:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935541:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935546:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935552:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935557:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935562:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935567:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935584:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935589:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935594:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935600:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935605:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935613:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935619:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935624:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935629:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935633:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935638:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935643:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935647:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935653:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935658:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935663:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935667:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935681:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935687:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935692:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935697:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935702:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935707:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935711:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935717:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935722:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935726:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935731:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935735:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935746:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935751:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935756:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935761:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935766:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935771:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935776:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935781:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935785:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935790:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935795:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935800:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935805:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935810:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935814:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935819:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935823:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935828:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935833:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935837:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935842:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935847:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935852:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935857:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.935862:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936554:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99437a58d200:6707] 1 exiting: rc = 0 00000100:00100000:2.0:1788263383.936602:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff994347c41000:6706] 0 exiting: rc = 1 00000100:00100000:2.0:1788263383.936634:0:11722:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99435110cc00:11722] 2 exiting: rc = 0 00000100:00100000:2.0:1788263383.936668:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936687:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936693:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936699:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936704:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936709:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936721:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936726:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936731:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936736:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936742:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936747:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936752:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936756:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936761:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936766:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936770:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936775:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936779:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936784:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936788:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936793:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936797:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936802:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936806:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936811:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936816:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936820:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936825:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936830:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936834:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936839:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936843:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936848:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936853:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936858:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936862:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936866:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936871:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936875:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936891:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936900:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936907:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936912:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936917:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936922:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936927:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936931:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936937:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936942:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936946:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936951:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936956:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936961:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936966:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936970:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936975:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936979:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936984:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936989:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936993:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.936998:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.937002:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.937007:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.937666:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99437a58d800:6709] 1 exiting: rc = 0 00000100:00100000:2.0:1788263383.937818:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99437a58c600:6710] 2 exiting: rc = 0 00000100:00100000:2.0:1788263383.937950:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff994347c40c00:6708] 0 exiting: rc = 1 00000100:00100000:2.0:1788263383.937989:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.937996:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938002:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938008:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938014:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938020:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938026:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938032:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938044:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938050:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938056:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938062:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938067:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938072:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938078:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938083:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938088:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938095:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938109:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938115:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938120:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938125:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938130:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938135:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938140:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938146:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938151:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938156:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938161:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938166:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938171:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938176:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938180:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938185:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938190:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938195:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938200:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938205:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938210:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938215:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938237:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938242:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938258:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938268:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938273:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938279:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938284:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938289:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938295:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938300:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938305:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938311:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938316:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938321:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938333:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938339:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938345:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938350:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938357:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938363:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938368:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938374:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938379:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.938384:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.946734:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff994343ea4800:6712] 1 exiting: rc = 0 00000100:00100000:3.0:1788263383.955249:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff994343ea5800:6711] 0 exiting: rc = 1 00000100:00100000:2.0:1788263383.958950:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.958959:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.958965:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.958969:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.958974:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.958979:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.958984:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.958990:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.958996:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959001:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959006:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959010:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959015:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959037:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959042:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959047:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959052:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959056:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959060:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959066:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959070:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959075:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959080:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959085:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959090:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959096:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959100:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959104:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959109:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959113:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959118:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959123:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959127:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959131:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959136:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959140:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959145:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959150:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959155:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959160:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959165:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959169:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959173:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959179:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959184:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959189:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959194:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959198:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959210:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959233:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959240:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959246:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959251:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959256:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959261:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959266:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959271:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959276:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959281:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959286:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959291:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959296:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959301:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.959318:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.960037:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff994343ea5600:6714] 1 exiting: rc = 0 00000100:00100000:1.0:1788263383.961794:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff994343ea4400:6713] 0 exiting: rc = 1 00000100:00100000:2.0:1788263383.962466:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962483:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962490:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962496:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962502:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962507:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962518:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962524:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962530:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962535:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962542:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962548:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962553:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962559:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962565:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962570:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962584:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.962590:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963283:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963292:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963298:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963303:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963309:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963315:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963320:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963326:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963332:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963347:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963354:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963360:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963380:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963387:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963393:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963402:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963408:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963413:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963418:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963424:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963430:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963435:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963441:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963546:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963567:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963838:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963845:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963851:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963857:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963863:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963869:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963875:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963881:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963889:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963894:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963908:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963925:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963932:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963937:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963943:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963949:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963955:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963961:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963968:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963974:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263383.963980:0:13400:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788263383.989754:0:13400:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788263400.919564:0:14017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788263408.791868:0:14479:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263408.791874:0:14479:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788263408.791982:0:14479:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99434660c800 00000020:01000004:2.0:1788263408.791998:0:14479:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788263408.792005:0:14479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788263408.792018:0:14479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff994349ce3370) 00000020:00000080:2.0:1788263408.792032:0:14479:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788263408.818876:0:14479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788263408.831060:0:14479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788263408.833852:0:14479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788263408.833938:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 433: rc = 0 00100000:10000000:0.0:1788263408.835500:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 433: rc = 0 00100000:10000000:0.0:1788263408.835614:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 433: rc = 0 00100000:10000000:0.0:1788263408.835714:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 433: rc = 0 00100000:10000000:0.0:1788263408.835807:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 433: rc = 0 00100000:10000000:0.0:1788263408.835899:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 433: rc = 0 00100000:10000000:0.0:1788263408.837542:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 435: rc = 0 00100000:10000000:0.0:1788263408.839755:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 770: rc = 0 00100000:10000000:0.0:1788263408.839856:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 770: rc = 0 00100000:10000000:0.0:1788263408.840907:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788263408.841517:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:0.0:1788263408.841766:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788263408.842716:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:0.0:1788263408.843391:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:0.0:1788263408.843635:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788263408.843882:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:0.0:1788263408.844122:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:0.0:1788263408.844921:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:2.0:1788263408.845691:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1788263408.845957:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1788263408.846518:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1788263408.846942:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 574: rc = 0 00100000:10000000:2.0:1788263408.847607:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 574: rc = 0 00100000:10000000:2.0:1788263408.847868:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 574: rc = 0 00100000:10000000:2.0:1788263408.856571:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 574: rc = 0 00100000:10000000:2.0:1788263408.856824:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 574: rc = 0 00100000:10000000:2.0:1788263408.857043:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 574: rc = 0 00100000:10000000:3.0:1788263408.858752:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 574: rc = 0 00100000:10000000:3.0:1788263408.859429:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 574: rc = 0 00100000:10000000:3.0:1788263408.859713:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 574: rc = 0 00100000:10000000:3.0:1788263408.859966:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 574: rc = 0 00100000:10000000:3.0:1788263408.860952:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 574: rc = 0 00100000:10000000:3.0:1788263408.864743:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 574: rc = 0 00100000:10000000:3.0:1788263408.865018:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 574: rc = 0 00100000:10000000:3.0:1788263408.865317:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 574: rc = 0 00100000:10000000:3.0:1788263408.865549:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 574: rc = 0 00100000:10000000:3.0:1788263408.865829:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 574: rc = 0 00100000:10000000:3.0:1788263408.866076:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 574: rc = 0 00100000:10000000:3.0:1788263408.867451:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 574: rc = 0 00100000:10000000:3.0:1788263408.867705:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 574: rc = 0 00100000:10000000:3.0:1788263408.867942:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 574: rc = 0 00100000:10000000:3.0:1788263408.869690:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 574: rc = 0 00100000:10000000:3.0:1788263408.872395:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 574: rc = 0 00100000:10000000:3.0:1788263408.872787:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 574: rc = 0 00100000:10000000:3.0:1788263408.874831:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 574: rc = 0 00100000:10000000:3.0:1788263408.876423:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 574: rc = 0 00100000:10000000:3.0:1788263408.876711:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 574: rc = 0 00100000:10000000:3.0:1788263408.876923:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 574: rc = 0 00100000:10000000:3.0:1788263408.880720:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 574: rc = 0 00100000:10000000:3.0:1788263408.881504:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 574: rc = 0 00100000:10000000:3.0:1788263408.881784:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 574: rc = 0 00100000:10000000:3.0:1788263408.882026:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 574: rc = 0 00100000:10000000:3.0:1788263408.884661:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 574: rc = 0 00100000:10000000:3.0:1788263408.886553:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 655: rc = 0 00100000:10000000:3.0:1788263408.888861:0:14479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788263408.889647:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:2.0:1788263408.889883:0:14479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788263408.889958:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:2.0:1788263408.890376:0:14479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788263408.890450:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:2.0:1788263408.890778:0:14479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788263408.890852:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:2.0:1788263408.891033:0:14479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788263408.891094:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:2.0:1788263408.892435:0:14479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788263408.892523:0:14479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00000020:00000080:2.0:1788263408.892795:0:14479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788263408.892802:0:14479:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788263408.892812:0:14479:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513956b13 00000020:01000004:2.0:1788263408.892819:0:14479:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788263408.892825:0:14479:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788263408.892829:0:14479:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99434660c800 from MGS 00000020:01000004:2.0:1788263408.892833:0:14479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788263408.892842:0:14479:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff994349ce19b8) 00000020:00000080:2.0:1788263408.892851:0:14479:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788263408.892902:0:14479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99434660c800 from MGS, refs=2 00080000:01000000:2.0:1788263408.892907:0:14479:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788263408.892913:0:14479:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513956b21 00000100:00100000:2.0:1788263408.893503:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788263408.893643:0:14479:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788263408.893649:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788263408.900953:0:14479:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788263408.901100:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788263408.901972:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263408.902559:0:14479:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788263408.902566:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788263408.910118:0:14479:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788263408.910132:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788263408.910918:0:14479:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788263408.910925:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788263408.912599:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263408.912604:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263408.912606:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263408.918009:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263408.918015:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263408.918018:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263408.919446:0:14479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788263408.928651:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788263408.948580:0:14479:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788263408.948601:0:14479:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788263408.948604:0:14479:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788263408.952569:0:14488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788263408.953856:0:14479:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788263408.953988:0:14479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788263408.955736:0:14479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788263408.956042:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263408.956282:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788263408.956288:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788263408.963940:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788263408.963955:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788263408.964788:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788263408.964797:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788263408.967318:0:14479:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788263408.967341:0:14479:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.129@tcp' 00000020:01000004:1.0:1788263408.967343:0:14479:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788263408.967372:0:14479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.129@tcp (typ=mgc) 00000020:00000080:1.0:1788263408.967384:0:14479:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.129@tcp (ffff994346b34d28) 00000020:00000080:1.0:1788263408.967398:0:14479:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788263408.967478:0:14479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9942421ac800@MGC192.168.201.129@tcp: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788263408.967621:0:14479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.129@tcp-0 is initialized 00000040:01000000:1.0:1788263408.967628:0:14479:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788263408.968764:0:14493:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788263408.969938:0:14494:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788263408.971359:0:14479:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.129@tcp (uuid 91f17ece-9654-41b2-8823-2d6af9d5176a) 00000020:00000080:2.0:1788263408.971390:0:14479:0:(genops.c:1385:class_connect()) connect: client 91f17ece-9654-41b2-8823-2d6af9d5176a, cookie 0x1a657bc513956b2f 00000100:00080000:2.0:1788263408.971403:0:14479:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263408.971409:0:14479:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9942421ac800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788263408.971445:0:14479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9943810db800 x1875129753749632/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263408.971479:0:14479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS 00000020:01000004:2.0:1788263408.971503:0:14479:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788263408.971529:0:14479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788263408.971543:0:14479:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff994349ce0000) 00000020:00000080:2.0:1788263408.971556:0:14479:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788263408.971568:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91f17ece-9654-41b2-8823-2d6af9d5176a:3319:1875129753749632:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788263408.971635:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263408.971714:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753749632 00000100:00100000:1.0:1788263408.971722:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753749632 00000100:00100000:1.0:1788263408.971766:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263408.971774:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3319:x1875129753749632:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788263408.971798:0:14490:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 91f17ece-9654-41b2-8823-2d6af9d5176a@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:1.0:1788263408.971819:0:14490:0:(genops.c:1385:class_connect()) connect: client 91f17ece-9654-41b2-8823-2d6af9d5176a, cookie 0x1a657bc513956b3d 00000100:00080000:1.0:1788263408.971950:0:14490:0:(import.c:65:import_set_state_nolock()) ffff9942421a8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263408.972027:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+5:3319:x1875129753749632:12345-0@lo:250:mount.lustre.0 Request processed in 251us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263408.972035:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263408.972072:0:3319:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788263408.972081:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.129@tcp: connect to target with instance 0 00000100:00080000:1.0:1788263408.972089:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788263408.972094:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788263408.972097:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9942421ac800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788263408.972100:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788263408.972121:0:3319:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788263408.972126:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91f17ece-9654-41b2-8823-2d6af9d5176a:3319:1875129753749632:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788263408.998045:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263408.999771:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788263408.999779:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788263409.003108:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788263409.003122:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788263409.003603:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788263409.003610:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788263409.006152:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263409.006390:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788263409.006396:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788263409.009915:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788263409.009927:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788263409.088751:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263409.088959:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788263409.088966:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788263409.098927:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788263409.098944:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788263409.106325:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263409.106521:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788263409.106533:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788263409.107067:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788263409.107074:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788263409.108673:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263409.108844:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788263409.108850:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788263409.125772:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788263409.126260:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788263409.129495:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263409.129696:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788263409.129702:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788263409.131394:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788263409.131404:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788263409.178715:0:14479:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788263409.178928:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788263409.178936:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788263409.184909:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788263409.185003:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788263409.186043:0:14479:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788263409.186053:0:14479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788263409.186923:0:14479:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788263409.186948:0:14479:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788263409.186955:0:14479:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788263409.187114:0:14479:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788263409.187549:0:14479:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788263409.187554:0:14479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788263409.187556:0:14479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263409.187558:0:14479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263409.187559:0:14479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263409.187561:0:14479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263409.187562:0:14479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263409.187563:0:14479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263409.187565:0:14479:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263409.187567:0:14479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263409.187568:0:14479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263409.187571:0:14479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788263409.187573:0:14479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263409.187575:0:14479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263409.187576:0:14479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263409.187577:0:14479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263409.187578:0:14479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263409.187579:0:14479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263409.187580:0:14479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263409.187581:0:14479:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263409.187582:0:14479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263409.187583:0:14479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788263409.187934:0:14479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788263409.187963:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347207b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753749760:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788263409.188054:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263409.188107:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff994350dd7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263409.188125:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753749760 00000100:00100000:2.0:1788263409.188284:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753749760 00000100:00100000:0.0:1788263409.188366:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263409.188378:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+5:14479:x1875129753749760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788263409.188432:0:14492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788263409.188435:0:14492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788263409.188438:0:14492:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788263409.188837:0:14513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788263409.189298:0:14492:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788263409.194334:0:14514:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788263409.194343:0:14514:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788263409.194346:0:14514:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788263409.194380:0:14514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788263409.194750:0:14492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788263409.194761:0:14492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788263409.213802:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+5:14479:x1875129753749760:12345-0@lo:253:mount.lustre.0 Request processed in 25418us (25739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.213822:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263409.213990:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347207b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753749760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788263409.214006:0:14479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788263409.214010:0:14479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263409.214011:0:14479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788263409.214013:0:14479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263409.214014:0:14479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263409.214015:0:14479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263409.214016:0:14479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263409.214031:0:14479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263409.214033:0:14479:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788263409.214034:0:14479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263409.214036:0:14479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788263409.214053:0:14479:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99434660c800 from lustre-MDT0000 10000000:01000000:0.0:1788263409.214076:0:14479:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788263409.214078:0:14479:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788263409.214082:0:14479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff994346b34d28 10000000:01000000:0.0:1788263409.214088:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788263409.214095:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff994346b34d28 from 1 10000000:01000000:0.0:1788263409.214098:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788263409.214185:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263409.214197:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263409.214206:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263409.214306:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347207b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753749888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788263409.214343:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263409.214422:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff994350dd79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263409.232337:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753749888 00000100:00100000:1.0:1788263409.232354:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753749888 00000100:00100000:1.0:1788263409.233336:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263409.233361:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+5:14479:x1875129753749888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263409.233378:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263409.233398:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99437f6b1a00/0x1a657bc513956b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956b44 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.233424:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99437f6b1a00/0x1a657bc513956b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956b44 expref: 6 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.233436:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99437f6b1a00/0x1a657bc513956b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956b44 expref: 6 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.233446:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b1a00, rc 0) 00000100:00100000:1.0:1788263409.233547:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+6:14479:x1875129753749888:12345-0@lo:101:mount.lustre.0 Request processed in 189us (19203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263409.233555:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263409.233884:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347207b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753749888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263409.233903:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.233912:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263409.233977:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263409.234011:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263409.234053:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f2c3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263409.235566:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753750016 00000100:00100000:1.0:1788263409.235577:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753750016 00000100:00100000:1.0:1788263409.235635:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263409.235645:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+6:14479:x1875129753750016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263409.235929:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+6:14479:x1875129753750016:12345-0@lo:501:mount.lustre.0 Request processed in 285us (1917us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263409.235937:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263409.236016:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750016:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788263409.236054:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788263409.236076:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.236086:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263409.236094:0:14479:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99434660c800 10000000:01000000:2.0:1788263409.236099:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788263409.236104:0:14479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99434660c800 10000000:01000000:2.0:1788263409.236106:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788263409.236110:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99434660c800 from 1 10000000:01000000:2.0:1788263409.236113:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788263409.236142:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.236149:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.236166:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263409.236194:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263409.236265:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263409.236298:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f2c3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263409.236404:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753750144 00000100:00100000:3.0:1788263409.236410:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753750144 00000100:00100000:3.0:1788263409.236443:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263409.236450:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+6:14479:x1875129753750144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263409.236460:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263409.236474:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216c000/0x1a657bc513956b59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956b52 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.236494:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216c000/0x1a657bc513956b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956b52 expref: 7 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.236504:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216c000/0x1a657bc513956b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956b52 expref: 7 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.236512:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216c000, rc 0) 00000100:00100000:3.0:1788263409.236555:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+7:14479:x1875129753750144:12345-0@lo:101:mount.lustre.0 Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.236568:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263409.237444:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263409.237462:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.237473:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263409.237506:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788263409.237515:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.237522:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263409.237529:0:14479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788263409.237533:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788263409.237537:0:14479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99434660c800 10000000:01000000:1.0:1788263409.237540:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788263409.237543:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788263409.237545:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788263409.237568:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.237576:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.237583:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263409.237600:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788263409.237634:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.237670:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375fdd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788263409.237715:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753750272 00000100:00100000:3.0:1788263409.237720:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753750272 00000100:00100000:3.0:1788263409.237759:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788263409.237767:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+7:14479:x1875129753750272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263409.237777:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263409.237787:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216de00/0x1a657bc513956b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956b60 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.237802:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216de00/0x1a657bc513956b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956b60 expref: 8 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.237811:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216de00/0x1a657bc513956b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956b60 expref: 8 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.237818:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216de00, rc 0) 00000100:00100000:3.0:1788263409.238078:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+8:14479:x1875129753750272:12345-0@lo:101:mount.lustre.0 Request processed in 311us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.238085:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263409.238955:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263409.238973:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.238983:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263409.239051:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263409.239087:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263409.239178:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f2c3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788263409.240654:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753750400 00000100:00100000:0.0:1788263409.240666:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753750400 00000100:00100000:0.0:1788263409.240854:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263409.240866:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+8:14479:x1875129753750400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263409.241363:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+9:14479:x1875129753750400:12345-0@lo:501:mount.lustre.0 Request processed in 499us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263409.241372:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263409.241468:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263409.241520:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263409.241569:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263409.250456:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753750528 00000100:00100000:3.0:1788263409.250472:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753750528 00000100:00100000:2.0:1788263409.250502:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f2c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263409.250562:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263409.250571:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+9:14479:x1875129753750528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263409.250911:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+9:14479:x1875129753750528:12345-0@lo:503:mount.lustre.0 Request processed in 340us (9341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263409.250929:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263409.250953:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753750528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263409.254090:0:14515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14515:1875129753750656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263409.254191:0:14515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.254273:0:14515:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375fdd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788263409.254349:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753750656 00000100:00100000:0.0:1788263409.254362:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753750656 00000100:00100000:0.0:1788263409.254415:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263409.254426:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+9:14515:x1875129753750656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263409.254732:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+9:14515:x1875129753750656:12345-0@lo:502:llog_process_th.0 Request processed in 307us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263409.254740:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263409.260279:0:14515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14515:1875129753750656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263409.260337:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263409.260353:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263409.260356:0:14515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788263409.260362:0:14515:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788263409.260366:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788263409.260383:0:14515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff994349ce4d28) 00000020:00000080:2.0:1788263409.260407:0:14515:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788263409.260413:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788263409.260511:0:14515:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788263409.260519:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513956b75 00000020:00000080:2.0:1788263409.260750:0:14515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788263409.260756:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263409.260759:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263409.260761:0:14515:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788263409.260764:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263409.260767:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263409.260768:0:14515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788263409.260771:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788263409.260787:0:14515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9943809499b8) 00000020:00000080:2.0:1788263409.260798:0:14515:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788263409.260804:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788263409.260806:0:14515:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788263409.260809:0:14515:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788263409.260815:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788263409.260879:0:14515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99434660c800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788263409.260894:0:14515:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99438094b370) 00000020:00000080:2.0:1788263409.260903:0:14515:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788263409.260948:0:14515:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788263409.260954:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513956b8a 00000020:00000080:2.0:1788263409.261066:0:14515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788263409.261072:0:14515:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788263409.261078:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1a657bc513956b91 00080000:01000000:2.0:1788263409.261083:0:14515:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788263409.261087:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513956b98 00010000:00010000:2.0:1788263409.346372:0:14515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788263409.346879:0:14515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788263409.347058:0:14515:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788263409.347778:0:14515:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff994380948000) 00000020:00000080:2.0:1788263409.347797:0:14515:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788263409.347856:0:14515:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788263409.347864:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513956ba6 00000020:00000080:1.0:1788263409.348522:0:14515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788263409.351555:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1a657bc513956bad 00000020:00000080:0.0:1788263409.355702:0:14515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788263409.355714:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263409.355720:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263409.355722:0:14515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788263409.355725:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788263409.355727:0:14515:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788263409.355728:0:14515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263409.355729:0:14515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263409.355730:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788263409.355732:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263409.355733:0:14515:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788263409.355734:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263409.355738:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263409.355738:0:14515:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788263409.355741:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788263409.355774:0:14515:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788263409.355785:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263409.355786:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263409.355787:0:14515:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788263409.355788:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788263409.355790:0:14515:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788263409.355792:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263409.355793:0:14515:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788263409.355795:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788263409.355799:0:14515:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:0.0:1788263409.355825:0:14515:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788263409.355832:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263409.355845:0:14515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99437f9cb370) 00000020:00000080:0.0:1788263409.355858:0:14515:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788263409.355861:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788263409.355905:0:14515:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788263409.355909:0:14515:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788263409.355915:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513956bbb 00010000:00080000:0.0:1788263409.355949:0:14515:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99434646c800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1788263409.356214:0:14515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788263409.356559:0:14515:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788263409.357205:0:14515:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788263409.359104:0:14515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263409.359285:0:14515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788263409.359368:0:14515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788263409.359745:0:14519:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788263409.359750:0:14519:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788263409.362405:0:14515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788263409.362417:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788263409.362448:0:14515:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788263409.362463:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513956bc2 00000100:00080000:1.0:1788263409.362471:0:14515:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788263409.362475:0:14515:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99434646c800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263409.362502:0:14515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437f509180 x1875129753750784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788263409.362523:0:14515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788263409.362563:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753750784:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788263409.362624:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129753750784 offset 0 length 520: 4 00000020:01000000:1.0:1788263409.362718:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263409.362721:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263409.362722:0:14515:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788263409.362724:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788263409.362726:0:14515:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788263409.362727:0:14515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788263409.362728:0:14515:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788263409.362729:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788263409.362730:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263409.362731:0:14515:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788263409.362732:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788263409.362735:0:14515:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788263409.362737:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263409.362738:0:14515:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788263409.362739:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788263409.362742:0:14515:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:1.0:1788263409.362766:0:14515:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788263409.362780:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263409.362789:0:14515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff994346b33370) 00000020:00000080:1.0:1788263409.362798:0:14515:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788263409.362802:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788263409.362850:0:14515:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788263409.362855:0:14515:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788263409.362859:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513956bd0 00010000:00080000:1.0:1788263409.362894:0:14515:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99437fb70800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788263409.363067:0:14515:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788263409.363314:0:14515:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788263409.363338:0:14515:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788263409.364252:0:14515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263409.364336:0:14515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788263409.364410:0:14515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788263409.365098:0:14521:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788263409.365103:0:14521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788263409.366531:0:14515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788263409.366543:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788263409.366575:0:14515:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788263409.366672:0:14515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513956bd7 00000100:00080000:3.0:1788263409.366683:0:14515:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263409.366689:0:14515:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99437fb70800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263409.366733:0:14515:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437630e680 x1875129753750912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263409.366799:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753750912:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788263409.366856:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129753750912 offset 0 length 520: 4 00000100:00080000:3.0:1788263409.366915:0:14515:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788263409.366980:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263409.366984:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263409.366986:0:14515:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788263409.366989:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263409.366993:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263409.366994:0:14515:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788263409.366997:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788263409.366999:0:14515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788263409.367001:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263409.367004:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263409.367005:0:14515:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788263409.367007:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263409.367009:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263409.367010:0:14515:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788263409.367013:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788263409.367042:0:14515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14515:1875129753751040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263409.367093:0:14515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263409.367128:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753751040 00000100:00100000:3.0:1788263409.367411:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753751040 00000100:00100000:3.0:1788263409.367453:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788263409.367462:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+9:14515:x1875129753751040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263409.367786:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+9:14515:x1875129753751040:12345-0@lo:502:llog_process_th.0 Request processed in 324us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.367792:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788263409.367830:0:14515:0:(client.c:2715:ptlrpc_set_wait()) set ffff994380c86a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263409.367846:0:14515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14515:1875129753751040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788263409.367872:0:14515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263409.367875:0:14515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263409.367876:0:14515:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788263409.367879:0:14515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788263409.368203:0:14479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788263409.368329:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788263409.368390:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.368398:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263409.368404:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99434660c800 from 1 10000000:01000000:1.0:1788263409.368406:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788263409.368430:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.368435:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.368450:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263409.368463:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788263409.368497:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.368527:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263409.368573:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753751168 00000100:00100000:3.0:1788263409.368578:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753751168 00000100:00100000:3.0:1788263409.368614:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263409.368622:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+9:14479:x1875129753751168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263409.368633:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263409.368645:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956bde expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.368664:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956bde expref: 10 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.368672:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956bde expref: 10 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.368678:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d200, rc 0) 00000100:00100000:3.0:1788263409.368707:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+10:14479:x1875129753751168:12345-0@lo:101:mount.lustre.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.368711:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263409.368758:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263409.368768:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.368774:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263409.369163:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751296:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788263409.369196:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.369213:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263409.369461:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753751296 00000100:00100000:3.0:1788263409.369466:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753751296 00000100:00100000:3.0:1788263409.369497:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263409.369504:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+10:14479:x1875129753751296:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788263409.369518:0:14491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788263409.369524:0:14491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788263409.369602:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+10:14479:x1875129753751296:12345-0@lo:256:mount.lustre.0 Request processed in 98us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.369611:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263409.369691:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751296:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788263409.370106:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788263409.370290:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.370300:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263409.370309:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99434660c800 from 1 10000000:01000000:1.0:1788263409.370312:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263409.370340:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.370345:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.370351:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263409.370360:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788263409.370383:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.370408:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263409.370416:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753751424 00000100:00100000:3.0:1788263409.370420:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753751424 00000100:00100000:3.0:1788263409.370487:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263409.370492:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+10:14479:x1875129753751424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263409.370499:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263409.370507:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956bec expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.370526:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956bec expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.370535:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956bec expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.370542:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d800, rc 0) 00000100:00100000:3.0:1788263409.370580:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14479:x1875129753751424:12345-0@lo:101:mount.lustre.0 Request processed in 87us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.370586:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788263409.370648:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263409.370657:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.370663:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263409.370698:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263409.370714:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.370820:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263409.370846:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753751552 00000100:00100000:0.0:1788263409.370853:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753751552 00000100:00100000:0.0:1788263409.370878:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263409.370884:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14479:x1875129753751552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263409.371584:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14479:x1875129753751552:12345-0@lo:501:mount.lustre.0 Request processed in 700us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263409.371679:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263409.371703:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263409.371731:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263409.371776:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f2c3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263409.371801:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788263409.371819:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753751680 00000100:00100000:1.0:1788263409.371821:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753751680 00000100:00100000:3.0:1788263409.371849:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788263409.371854:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14479:x1875129753751680:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263409.371961:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14479:x1875129753751680:12345-0@lo:503:mount.lustre.0 Request processed in 103us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.371968:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263409.371993:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753751680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263409.372364:0:14523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14523:1875129753751808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263409.372391:0:14523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.372495:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753751808 00000100:00100000:1.0:1788263409.372499:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753751808 00000100:00100000:2.0:1788263409.372508:0:14523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263409.372539:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788263409.372546:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14523:x1875129753751808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263409.372758:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14523:x1875129753751808:12345-0@lo:502:llog_process_th.0 Request processed in 212us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.372764:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263409.372811:0:14523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14523:1875129753751808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263409.372834:0:14523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263409.372843:0:14523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263409.372845:0:14523:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788263409.372850:0:14523:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99434660c800 00000020:00000080:2.0:1788263409.372852:0:14523:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263409.372859:0:14523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263409.372861:0:14523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263409.372862:0:14523:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788263409.372865:0:14523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263409.372866:0:14523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263409.372867:0:14523:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788263409.372870:0:14523:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99434660c800 00000020:00000080:2.0:1788263409.372872:0:14523:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263409.372917:0:14523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263409.372920:0:14523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263409.372921:0:14523:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788263409.372923:0:14523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263409.372925:0:14523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263409.372926:0:14523:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788263409.372929:0:14523:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99434660c800 00000020:00000080:2.0:1788263409.372931:0:14523:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788263409.372957:0:14523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14523:1875129753751936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263409.372982:0:14523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263409.373277:0:14523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263409.374690:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753751936 00000100:00100000:0.0:1788263409.374701:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753751936 00000100:00100000:0.0:1788263409.374740:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263409.374749:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14523:x1875129753751936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263409.377286:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14523:x1875129753751936:12345-0@lo:502:llog_process_th.0 Request processed in 2528us (4293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263409.377300:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788263409.377898:0:14523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14523:1875129753751936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788263409.377938:0:14523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263409.377945:0:14523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263409.377948:0:14523:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788263409.377953:0:14523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788263409.381258:0:14479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788263409.381297:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263409.381375:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.381387:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263409.381447:0:14479:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788263409.381450:0:14479:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99434660c800 10000000:01000000:2.0:1788263409.381453:0:14479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99434660c800 10000000:01000000:2.0:1788263409.381457:0:14479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263409.381463:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99434660c800 from 1 10000000:01000000:2.0:1788263409.381466:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788263409.381502:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.381510:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.381522:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263409.381546:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753752064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263409.382262:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.382297:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753752064 00000100:00100000:1.0:1788263409.382304:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753752064 00000100:00100000:2.0:1788263409.382308:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263409.382355:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263409.382365:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14479:x1875129753752064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263409.382378:0:14491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263409.382390:0:14491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99437f6b0a00/0x1a657bc513956c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956bfa expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.382413:0:14491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99437f6b0a00/0x1a657bc513956c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956bfa expref: 12 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.382424:0:14491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99437f6b0a00/0x1a657bc513956c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956bfa expref: 12 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.382434:0:14491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0a00, rc 0) 00000100:00100000:1.0:1788263409.382472:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14479:x1875129753752064:12345-0@lo:101:mount.lustre.0 Request processed in 109us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263409.382479:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788263409.382706:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753752064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263409.382718:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.382725:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263409.382766:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753752192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263409.382785:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263409.382813:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263409.382827:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753752192 00000100:00100000:1.0:1788263409.382832:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753752192 00000100:00100000:1.0:1788263409.382863:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788263409.382870:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14479:x1875129753752192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263409.383111:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14479:x1875129753752192:12345-0@lo:501:mount.lustre.0 Request processed in 240us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263409.383118:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263409.383247:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753752192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263409.383273:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753752320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263409.383303:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263409.383320:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753752320 00000100:00100000:2.0:1788263409.383323:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753752320 00000100:00100000:2.0:1788263409.383345:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263409.383352:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14479:x1875129753752320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263409.383469:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14479:x1875129753752320:12345-0@lo:503:mount.lustre.0 Request processed in 117us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263409.383476:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263409.383504:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788263409.383515:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753752320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263409.383754:0:14528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14528:1875129753752448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263409.383785:0:14528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.383814:0:14528:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263409.384247:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753752448 00000100:00100000:2.0:1788263409.384252:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753752448 00000100:00100000:2.0:1788263409.384280:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788263409.384288:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14528:x1875129753752448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263409.384465:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14528:x1875129753752448:12345-0@lo:502:llog_process_th.0 Request processed in 177us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263409.384472:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788263409.384495:0:14528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14528:1875129753752448:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788263409.384550:0:14528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788263409.384566:0:14528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff994346b30000) 00000020:00000080:1.0:1788263409.384585:0:14528:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788263409.384669:0:14528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99434660c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788263409.384673:0:14528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99434660c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788263409.384676:0:14528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99434660c800 4 00010000:00080000:1.0:1788263409.384704:0:14528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994381495000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788263409.386669:0:14528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788263409.387890:0:14528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788263409.387929:0:14528:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788263409.387945:0:14528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1a657bc513956c0f 00000100:00080000:0.0:1788263409.387955:0:14528:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263409.387966:0:14528:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff994381495000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788263409.388001:0:14528:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994347206d80 x1875129753752576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788263409.388039:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753752576:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788263409.388106:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263409.388254:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753752576 00000100:00100000:1.0:1788263409.388262:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753752576 00000100:00100000:1.0:1788263409.388289:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263409.388297:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875129753752576:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788263409.388388:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875129753752576:12345-0@lo:38:llog_process_th.0 Request processed in 90us (281us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788263409.388394:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263409.388400:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263409.388406:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994381495000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263409.388419:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788263409.388423:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753752576:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788263409.388460:0:14528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788263409.388763:0:14528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14528:1875129753752704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263409.388808:0:14528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263409.388829:0:14528:0:(client.c:2715:ptlrpc_set_wait()) set ffff994350dd79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263409.388957:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753752704 00000100:00100000:2.0:1788263409.388961:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753752704 00000100:00100000:2.0:1788263409.388990:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263409.388998:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14528:x1875129753752704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263409.389758:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14528:x1875129753752704:12345-0@lo:502:llog_process_th.0 Request processed in 758us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263409.389771:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788263409.389778:0:14528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347206d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:91f17ece-9654-41b2-8823-2d6af9d5176a:14528:1875129753752704:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788263409.389802:0:14528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788263409.389863:0:14479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788263409.389881:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788263409.389898:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263409.389909:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788263409.389948:0:14479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788263409.389949:0:14479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263409.389950:0:14479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263409.389952:0:14479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263409.389953:0:14479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263409.389954:0:14479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263409.389955:0:14479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263409.389956:0:14479:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263409.389958:0:14479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263409.389960:0:14479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788263409.389963:0:14479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788263409.389965:0:14479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263409.389966:0:14479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263409.389966:0:14479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263409.389967:0:14479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263409.389968:0:14479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263409.389968:0:14479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263409.389969:0:14479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263409.389970:0:14479:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263409.389971:0:14479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263409.389971:0:14479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788263409.389983:0:14479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788263409.389991:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753752832:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788263409.390015:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263409.390041:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263409.390047:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753752832 00000100:00100000:1.0:1788263409.390052:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753752832 00000100:00100000:1.0:1788263409.390076:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788263409.390083:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14479:x1875129753752832:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788263409.390111:0:14491:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788263409.390125:0:14491:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788263409.423045:0:14491:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788263409.423060:0:14491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788263409.423199:0:14513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788263409.423205:0:14513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788263409.423282:0:14513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263409.423300:0:14513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956bde expref: 12 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263409.423309:0:14513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263409.423348:0:14513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513956bde expref: 12 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263409.423364:0:14513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513956bde expref: 12 pid: 14490 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263409.423393:0:14513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14513:1875129753752960:0@lo:104: 00000100:00100000:0.0:1788263409.423461:0:14513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263409.423502:0:14513:0:(client.c:2715:ptlrpc_set_wait()) set ffff99436dcdbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263409.423537:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753752960 00000100:00100000:0.0:1788263409.423545:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753752960 00000100:00100000:0.0:1788263409.423584:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263409.423594:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+3:14513:x1875129753752960:12345-0@lo:104: 00010000:00010000:0.0:1788263409.423607:0:14480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263409.423657:0:14480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263409.423663:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+3:14513:x1875129753752960:12345-0@lo:104: Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263409.423669:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263409.423706:0:14513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14513:1875129753752960:0@lo:104: 00010000:00010000:0.0:1788263409.423723:0:14513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424018:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263409.424025:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424033:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1c00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:3.0:1788263409.424037:0:14486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424046:0:14486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263409.424053:0:14486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263409.424060:0:14486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263409.424096:0:14486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424103:0:14486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263409.424129:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424149:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956bde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956be5 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424164:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263409.424166:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263409.424168:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263409.424268:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263409.424279:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753753088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263409.424313:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263409.424346:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753753088 00000100:00100000:3.0:1788263409.424352:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753753088 00010000:00010000:3.0:1788263409.424371:0:14482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956bde expref: 13 pid: 14490 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263409.424399:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263409.424406:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+13:3322:x1875129753753088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788263409.424418:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263409.424423:0:14482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956bde expref: 13 pid: 14490 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424433:0:14482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513956bde expref: 13 pid: 14490 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424446:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216d200/0x1a657bc513956be5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513956bde expref: 13 pid: 14490 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424471:0:14482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424478:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788263409.424501:0:14482:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001297196s 00010000:00010000:3.0:1788263409.424505:0:14482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424512:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424518:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424524:0:14482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424528:0:14482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263409.424530:0:14482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424535:0:14482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424549:0:14482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263409.424557:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263409.424571:0:14513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263409.424589:0:14513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263409.424595:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+12:3322:x1875129753753088:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263409.424601:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263409.424751:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753753088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263409.424796:0:14513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380658000/0x1a657bc513956c16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263409.429485:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14479:x1875129753752832:12345-0@lo:253:mount.lustre.0 Request processed in 39391us (39457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263409.429501:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263409.429506:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:14479:1875129753752832:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788263409.429522:0:14479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788263409.429526:0:14479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263409.429527:0:14479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788263409.429528:0:14479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263409.429529:0:14479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263409.429531:0:14479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263409.429532:0:14479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263409.429533:0:14479:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263409.429535:0:14479:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788263409.429551:0:14479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263409.429552:0:14479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788263409.429570:0:14479:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788263409.433931:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263409.434037:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263409.434847:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263409.434947:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263409.435119:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263409.435840:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263409.437537:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263409.438324:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263409.438588:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263409.440351:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263409.440692:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263409.440849:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788263409.493061:0:14479:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788263409.493736:0:14479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788263409.494119:0:14536:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788263409.494210:0:14536:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263409.496469:0:14536:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788263409.496559:0:14536:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788263409.496564:0:14536:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788263409.498935:0:14479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788263409.499065:0:14479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788263409.499779:0:14535:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788263409.499785:0:14535:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:3.0:1788263409.500113:0:14479:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788263409.500448:0:14479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788263409.500787:0:14479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263409.506209:0:14479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788263409.506782:0:14479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788263409.506814:0:14479:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788263409.508321:0:14479:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788263409.524463:0:14479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788263409.571419:0:14479:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788263409.571451:0:14479:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb13201c4f988 00100000:10000000:1.0:1788263409.571459:0:14479:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788263409.571631:0:14479:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788263409.571646:0:14479:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788263409.571661:0:14479:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788263409.571686:0:14479:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788263409.984766:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788263410.172913:0:14494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788263410.172922:0:14494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99434660c800 from 6 10000000:01000000:0.0:1788263410.172927:0:14494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788263410.172975:0:14494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263410.172987:0:14494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263410.173000:0:14494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263410.173038:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753753216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263410.173109:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263410.173163:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943512f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263410.173262:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753753216 00000100:00100000:1.0:1788263410.173271:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753753216 00000100:00100000:1.0:1788263410.173317:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788263410.173327:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14494:x1875129753753216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263410.173348:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263410.173362:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956c1d expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263410.173385:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956c1d expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263410.173395:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956c1d expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263410.173405:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0600, rc 0) 00000100:00100000:1.0:1788263410.173445:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14494:x1875129753753216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263410.173452:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263410.173535:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753753216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263410.173550:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263410.173558:0:14494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263410.173619:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753753344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788263410.173649:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263410.173687:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943512f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263410.173753:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753753344 00000100:00100000:1.0:1788263410.173758:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753753344 00000100:00100000:1.0:1788263410.173789:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788263410.173796:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14494:x1875129753753344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788263410.173810:0:14491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263410.173824:0:14491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263410.173827:0:14491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788263410.173901:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14494:x1875129753753344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263410.173908:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263410.174699:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753753344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788263410.174745:0:14494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788263410.174753:0:14494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263410.174763:0:14494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263410.429150:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788263411.004790:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263411.453036:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788263412.028495:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263413.051725:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263414.080652:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788263414.302447:0:14779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788263414.540282:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263414.540289:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788263414.540298:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263414.540301:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788263414.540304:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788263414.540307:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788263414.540310:0:492:0:(import.c:65:import_set_state_nolock()) ffff994381495000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263414.540321:0:492:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff994381495000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263414.540342:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437f50bb80 x1875129753753600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263414.540389:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263414.540400:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753753472:0@lo:400:kworker.0 00000100:00100000:1.0:1788263414.540465:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263414.540518:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753753600:0@lo:38:kworker.0 00000100:00100000:1.0:1788263414.540548:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263414.540580:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753753472 00000100:00100000:1.0:1788263414.540588:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753753472 00000100:00100000:1.0:1788263414.540628:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788263414.540637:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+12:3321:x1875129753753472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263414.540683:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+12:3321:x1875129753753472:12345-0@lo:400:kworker.0 Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263414.540690:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788263414.540725:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753753600 00000100:00100000:1.0:1788263414.540729:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753753600 00000100:00100000:1.0:1788263414.540744:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263414.540755:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1875129753753600:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788263414.540775:0:14499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1788263414.540815:0:14499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1a657bc513956c2b 00000004:00100000:1.0:1788263414.540829:0:14499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788263414.540952:0:14499:0:(import.c:65:import_set_state_nolock()) ffff994347321000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263414.540998:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875129753753600:12345-0@lo:38:kworker.0 Request processed in 247us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263414.541004:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263414.541053:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753753472:0@lo:400:kworker.0 00010000:00080000:3.0:1788263414.543391:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99437f50bb80 x1875129753753600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788263414.543412:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788263414.543421:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788263414.543426:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788263414.543429:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994381495000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788263414.543435:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753753600:0@lo:38:kworker.0 00010000:00010000:0.0:1788263415.100889:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263416.123644:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263417.147887:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788263417.358969:0:14929:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3a3425a0 20000000:00000080:2.0:1788263417.358986:0:14929:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994377ac3000 uarg=0000000000000000 20000000:01000000:2.0:1788263417.359741:0:14929:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788263417.359749:0:14929:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788263417.359753:0:14929:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788263417.365048:0:14930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788263417.365142:0:14929:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788263417.385421:0:14929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788263417.385866:0:14929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263417.385893:0:14929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956bec expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263417.385903:0:14929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263417.385961:0:14929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513956bec expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263417.385981:0:14929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513956bec expref: 11 pid: 14490 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263417.386178:0:14929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14929:1875129753753728:0@lo:104: 00000100:00100000:1.0:1788263417.388594:0:14929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263417.388729:0:14929:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704240 going to sleep for 11 seconds 00000100:00100000:3.0:1788263417.388895:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753753728 00000100:00100000:3.0:1788263417.388907:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753753728 00000100:00100000:3.0:1788263417.388968:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263417.388980:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+3:14929:x1875129753753728:12345-0@lo:104: 00010000:00010000:3.0:1788263417.389242:0:14481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263417.389434:0:14481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263417.389441:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+3:14929:x1875129753753728:12345-0@lo:104: Request processed in 463us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263417.389469:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788263417.389544:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263417.389553:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.389562:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1600 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263417.389584:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.389595:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263417.389604:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263417.389610:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788263417.389659:0:14485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.389666:0:14485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263417.389700:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.389708:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99437f6b1600/0x1a657bc513956bec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956bf3 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.389739:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263417.389741:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263417.389743:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263417.389751:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263417.389766:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753753856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263417.389811:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263417.389864:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753753856 00000100:00100000:2.0:1788263417.389869:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753753856 00010000:00010000:2.0:1788263417.389890:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956bec expref: 12 pid: 14490 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263417.389925:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263417.389933:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:3320:x1875129753753856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263417.389946:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263417.389952:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956bec expref: 12 pid: 14490 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.389963:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513956bec expref: 12 pid: 14490 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.389983:0:14483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.390004:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.390027:0:14483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.390035:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.390042:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.390057:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.390062:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263417.390067:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.390082:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.390102:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263417.390114:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263417.390151:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:3320:x1875129753753856:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263417.390158:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263417.390201:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753753856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263417.391434:0:14929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216d800/0x1a657bc513956bf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513956bec expref: 11 pid: 14490 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263417.391455:0:14929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14929:1875129753753728:0@lo:104: 00010000:00010000:1.0:1788263417.391493:0:14929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263417.391505:0:14929:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263417.391511:0:14929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263417.391518:0:14929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99437f6b1800/0x1a657bc513956c32 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263418.172666:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788263418.686682:0:14494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788263418.686688:0:14494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99434660c800 from 10 10000000:01000000:1.0:1788263418.686693:0:14494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263418.686746:0:14494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263418.686758:0:14494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263418.686770:0:14494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263418.686793:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753753984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263418.686857:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263418.686910:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263418.686959:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753753984 00000100:00100000:3.0:1788263418.686967:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753753984 00000100:00100000:3.0:1788263418.687020:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263418.687030:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+11:14494:x1875129753753984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263418.687044:0:14491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263418.687056:0:14491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956c39 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263418.687115:0:14491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956c39 expref: 12 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263418.687125:0:14491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956c39 expref: 12 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263418.687135:0:14491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216ca00, rc 0) 00000100:00100000:3.0:1788263418.687171:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14494:x1875129753753984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263418.687178:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788263418.687584:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753753984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263418.687600:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263418.687621:0:14494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263418.687676:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753754112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263418.687714:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263418.687741:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263418.687784:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753754112 00000100:00100000:3.0:1788263418.687788:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753754112 00000100:00100000:3.0:1788263418.687817:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788263418.687825:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14494:x1875129753754112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263418.688074:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14494:x1875129753754112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263418.688083:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788263418.688539:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753754112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263418.688581:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753754240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263418.688620:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263418.688651:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263418.688689:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753754240 00000100:00100000:3.0:1788263418.688709:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753754240 00000100:00100000:3.0:1788263418.688738:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788263418.688745:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14494:x1875129753754240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263418.688882:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+12:14494:x1875129753754240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263418.688888:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788263418.689046:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753754240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788263418.690649:0:14976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788263418.690907:0:14494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788263418.690925:0:14494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263418.690936:0:14494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263418.690946:0:14494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263419.195507:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263419.643867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263419.643874:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788263419.643877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263419.643880:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788263419.643915:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753754496:0@lo:400:kworker.0 00000100:00100000:2.0:1788263419.643981:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263409/real 1788263409] req@ffff99437630e680 x1875129753750912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263419 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263419.643983:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263419.644034:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99437630e680 x1875129753750912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263419 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263419.644047:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263409/real 1788263409] req@ffff99437f509180 x1875129753750784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263419 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263419.644070:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263419.644079:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753754368:0@lo:400:kworker.0 00000100:00100000:2.0:1788263419.644108:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99437f509180 x1875129753750784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263419 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788263419.644126:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263419.644147:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788263419.644151:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753750912:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788263419.644159:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99434646c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263419.644166:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788263419.644173:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753750784:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788263419.644274:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753754496 00000100:00100000:2.0:1788263419.644283:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753754496 00000100:00100000:2.0:1788263419.644336:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263419.644482:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753754496:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788263419.646265:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263419.646274:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788263419.646279:0:8:0:(import.c:65:import_set_state_nolock()) ffff99434646c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263419.646286:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:1.0:1788263419.646291:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788263419.646299:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99434646c800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263419.646351:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437f50b480 x1875129753754624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788263419.646378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263419.646382:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788263419.646384:0:8:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263419.646408:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:1.0:1788263419.646411:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788263419.646426:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99437fb70800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263419.646440:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437f50a680 x1875129753754752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263419.646482:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753754624:0@lo:8:kworker.0 00000100:00100000:0.0:1788263419.647728:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263419.647755:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753754496:12345-0@lo:400:kworker.0 Request processed in 3270us (3767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263419.647773:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788263419.647818:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff994347204380 x1875129753754496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263419.647835:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753754496:0@lo:400:kworker.0 00000100:00100000:0.0:1788263419.647895:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753754368 00000100:00100000:0.0:1788263419.647903:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753754368 00000400:00000100:1.0:1788263419.647940:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129753754624 offset 0 length 520: 4 00000100:00100000:0.0:1788263419.647972:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263419.647984:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:3323:x1875129753754368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263419.647987:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753754752:0@lo:8:kworker.0 00000400:00000100:1.0:1788263419.648188:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129753754752 offset 0 length 520: 4 00000100:00100000:1.0:1788263419.663070:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:3323:x1875129753754368:12345-0@lo:400:kworker.0 Request processed in 15063us (15326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263419.663089:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788263419.672929:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753754368:0@lo:400:kworker.0 00010000:00010000:0.0:1788263420.225150:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263421.258271:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788263421.693649:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788263422.278250:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263423.297261:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788263423.906993:0:15180:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788263423.906997:0:15180:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788263423.907104:0:15180:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9943744b9800 00000020:01000004:0.0:1788263423.907118:0:15180:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788263423.907129:0:15180:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788263423.907142:0:15180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99437f9c8000) 00000020:00000080:0.0:1788263423.907155:0:15180:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788263423.925914:0:15180:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788263423.926265:0:15180:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788263423.926957:0:15180:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788263423.927178:0:15180:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788263423.927397:0:15180:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788263423.927752:0:15180:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 209: rc = 0 00100000:10000000:0.0:1788263423.927842:0:15180:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 209: rc = 0 00100000:10000000:0.0:1788263423.927932:0:15180:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 209: rc = 0 00100000:10000000:0.0:1788263423.929627:0:15180:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788263423.930399:0:15180:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 451: rc = 0 00100000:10000000:0.0:1788263423.930667:0:15180:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788263423.930894:0:15180:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 451: rc = 0 00100000:10000000:0.0:1788263423.931184:0:15180:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 451: rc = 0 00100000:10000000:0.0:1788263423.931447:0:15180:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 451: rc = 0 00000020:00000080:0.0:1788263423.932027:0:15180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788263423.932038:0:15180:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788263423.932050:0:15180:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1a657bc513956c4e 00000020:01000004:0.0:1788263423.932059:0:15180:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788263423.932078:0:15180:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788263423.932082:0:15180:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788263423.932088:0:15180:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788263423.932093:0:15180:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788263423.932103:0:15180:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99437f9ccd28) 00000020:00000080:0.0:1788263423.932114:0:15180:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788263423.940395:0:15180:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788263423.941173:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788263423.941180:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788263423.942775:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788263423.942786:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788263423.944037:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788263423.944048:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788263423.946581:0:15180:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263423.946775:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788263423.946782:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788263423.954912:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788263423.954932:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788263423.983428:0:15180:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263423.983635:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788263423.983641:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788263423.984874:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788263423.984885:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788263423.985887:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788263423.985897:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788263423.988028:0:15180:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263423.988204:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788263423.988252:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788263423.991686:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788263423.991699:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788263424.023675:0:15180:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263424.023850:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788263424.023858:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788263424.025364:0:15180:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788263424.025375:0:15180:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788263424.026160:0:15180:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788263424.026184:0:15180:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788263424.026190:0:15180:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788263424.051803:0:15180:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788263424.051842:0:15180:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788263424.051846:0:15180:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788263424.051848:0:15180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263424.051849:0:15180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263424.051850:0:15180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263424.051851:0:15180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263424.051852:0:15180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263424.051853:0:15180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263424.051855:0:15180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263424.051856:0:15180:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263424.051860:0:15180:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788263424.051861:0:15180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263424.051863:0:15180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263424.051864:0:15180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263424.051865:0:15180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263424.051866:0:15180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263424.051867:0:15180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263424.051868:0:15180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263424.051870:0:15180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263424.051870:0:15180:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263424.051909:0:15180:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788263424.051935:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753754880:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788263424.052015:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263424.052079:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372216180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263424.052308:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753754880 00000100:00100000:1.0:1788263424.052317:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753754880 00000100:00100000:1.0:1788263424.052374:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263424.052384:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:15180:x1875129753754880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788263424.052437:0:14492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788263424.052441:0:14492:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788263424.052445:0:14492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788263424.070436:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:15180:x1875129753754880:12345-0@lo:253:mount.lustre.0 Request processed in 18045us (18413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263424.070464:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788263424.070526:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753754880:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788263424.070543:0:15180:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788263424.070547:0:15180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788263424.070549:0:15180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263424.070550:0:15180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263424.070551:0:15180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263424.070552:0:15180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263424.070554:0:15180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263424.070555:0:15180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263424.070557:0:15180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263424.070558:0:15180:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788263424.070578:0:15180:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9943744b9800 from lustre-OST0000 10000000:01000000:3.0:1788263424.070604:0:15180:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788263424.070606:0:15180:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788263424.070613:0:15180:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994346b34d28 local copy 00010000:00010000:3.0:1788263424.070623:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263424.071024:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263424.071060:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263424.071100:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372216600 going to sleep for 11 seconds 00000100:00100000:1.0:1788263424.072436:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753755008 00000100:00100000:1.0:1788263424.072446:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753755008 00000100:00100000:1.0:1788263424.072518:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788263424.072529:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:15180:x1875129753755008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263424.072747:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+12:15180:x1875129753755008:12345-0@lo:501:mount.lustre.0 Request processed in 219us (1685us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263424.072755:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788263424.073041:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755008:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788263424.073062:0:15180:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788263424.073255:0:15180:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788263424.073264:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.073286:0:15180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263424.073314:0:15180:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9943744b9800 10000000:01000000:3.0:1788263424.073318:0:15180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788263424.073322:0:15180:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff994346b34d28 10000000:01000000:3.0:1788263424.073325:0:15180:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788263424.073328:0:15180:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff994346b34d28 from 1 10000000:01000000:3.0:1788263424.073331:0:15180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788263424.073359:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.073367:0:15180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.073377:0:15180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263424.073393:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263424.073500:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263424.073537:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372216600 going to sleep for 11 seconds 00000100:00100000:1.0:1788263424.074256:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753755136 00000100:00100000:1.0:1788263424.074263:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753755136 00000100:00100000:1.0:1788263424.074310:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263424.074319:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+12:15180:x1875129753755136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263424.074336:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263424.074350:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99437f6b1e00/0x1a657bc513956c63 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956c5c expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.074375:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99437f6b1e00/0x1a657bc513956c63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956c5c expref: 13 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.074386:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99437f6b1e00/0x1a657bc513956c63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956c5c expref: 13 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.074394:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b1e00, rc 0) 00000100:00100000:1.0:1788263424.074442:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+13:15180:x1875129753755136:12345-0@lo:101:mount.lustre.0 Request processed in 124us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263424.074448:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788263424.075142:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263424.075159:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c63 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.075170:0:15180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c63 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263424.075205:0:15180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788263424.075247:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c63 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.075255:0:15180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c63 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263424.075263:0:15180:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788263424.075267:0:15180:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263424.075273:0:15180:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788263424.075275:0:15180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788263424.075298:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.075303:0:15180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.075310:0:15180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263424.075326:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263424.075362:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263424.075550:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753755264 00000100:00100000:0.0:1788263424.075557:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753755264 00000100:00100000:0.0:1788263424.075594:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788263424.075603:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+13:15180:x1875129753755264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263424.075612:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263424.075622:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994380659e00/0x1a657bc513956c71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956c6a expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.075640:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380659e00/0x1a657bc513956c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956c6a expref: 14 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.075648:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994380659e00/0x1a657bc513956c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956c6a expref: 14 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.075679:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659e00, rc 0) 00000100:00100000:0.0:1788263424.075710:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755264:12345-0@lo:101:mount.lustre.0 Request processed in 108us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263424.075716:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788263424.075870:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372216600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263424.075894:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263424.075904:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.075913:0:15180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263424.076602:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788263424.078457:0:15180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263424.078706:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788263424.078743:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788263424.078768:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788263424.078804:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788263424.078830:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788263424.078855:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788263424.078904:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788263424.078910:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788263424.078994:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263424.079053:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263424.079099:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943722166c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263424.079520:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753755392 00000100:00100000:2.0:1788263424.079528:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753755392 00000100:00100000:2.0:1788263424.079573:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263424.079581:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263424.079870:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755392:12345-0@lo:501:mount.lustre.0 Request processed in 289us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263424.079889:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788263424.080313:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263424.080350:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263424.080395:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263424.080519:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943722166c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263424.082279:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753755520 00000100:00100000:2.0:1788263424.082289:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753755520 00000100:00100000:3.0:1788263424.083045:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788263424.083057:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263424.083580:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755520:12345-0@lo:503:mount.lustre.0 Request processed in 524us (3183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263424.083589:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788263424.083762:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788263424.089386:0:15180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788263424.089513:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263424.089595:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263424.089645:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943451e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263424.090173:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753755648 00000100:00100000:3.0:1788263424.090181:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753755648 00000100:00100000:3.0:1788263424.090249:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788263424.090259:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263424.090512:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755648:12345-0@lo:502:mount.lustre.0 Request processed in 253us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263424.090521:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263424.090632:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263424.090860:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788263424.090920:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788263424.090949:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788263424.091000:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788263424.091034:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788263424.091061:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788263424.091111:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788263424.091140:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788263424.091166:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788263424.091203:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788263424.091261:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788263424.091304:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788263424.091332:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263424.091372:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263424.091408:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263424.091541:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753755776 00000100:00100000:0.0:1788263424.091546:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753755776 00000100:00100000:0.0:1788263424.091583:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263424.091591:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263424.091746:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755776:12345-0@lo:502:mount.lustre.0 Request processed in 155us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263424.091753:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263424.092272:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263424.092365:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788263424.092377:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788263424.094657:0:15194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788263424.094668:0:15194:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788263424.094674:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263424.094677:0:15194:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788263424.094681:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788263424.094697:0:15194:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99438094cd28) 00000020:00000080:2.0:1788263424.094717:0:15194:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788263424.094722:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788263424.094793:0:15194:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9943744b9800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788263424.094801:0:15194:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788263424.094808:0:15194:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1a657bc513956c7f 00010000:00010000:2.0:1788263424.097942:0:15194:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788263424.102661:0:15194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788263424.105563:0:15194:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788263424.129285:0:15194:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788263424.129298:0:15194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263424.129305:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263424.129308:0:15194:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788263424.129311:0:15194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788263424.129314:0:15194:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788263424.129315:0:15194:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263424.129317:0:15194:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263424.129318:0:15194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788263424.129320:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263424.129335:0:15194:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788263424.129339:0:15194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263424.129341:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263424.129343:0:15194:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788263424.129346:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788263424.129348:0:15194:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788263424.129356:0:15194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263424.129359:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263424.129360:0:15194:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788263424.129362:0:15194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263424.129364:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263424.129365:0:15194:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788263424.129368:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788263424.129506:0:15194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263424.129511:0:15194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263424.129512:0:15194:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788263424.129515:0:15194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788263424.129684:0:15180:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788263424.129714:0:15180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788263424.129737:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.129749:0:15180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263424.129757:0:15180:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9943744b9800 from 1 10000000:01000000:1.0:1788263424.129760:0:15180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263424.129795:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.129802:0:15180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.129814:0:15180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263424.129838:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788263424.129900:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263424.129939:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994341377780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263424.130160:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753755904 00000100:00100000:0.0:1788263424.130167:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753755904 00000100:00100000:0.0:1788263424.130214:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788263424.130307:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+14:15180:x1875129753755904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263424.130321:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263424.130334:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956c86 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.130356:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956c86 expref: 15 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.130366:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956c86 expref: 15 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.130374:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658a00, rc 0) 00000100:00100000:0.0:1788263424.130547:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753755904:12345-0@lo:101:mount.lustre.0 Request processed in 241us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263424.130555:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788263424.132490:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753755904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263424.132517:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.132542:0:15180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788263424.133042:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788263424.133753:0:15180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263424.134009:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788263424.134054:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788263424.134114:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788263424.134122:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788263424.134185:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263424.134274:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263424.134312:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994341377780 going to sleep for 11 seconds 00000100:00100000:3.0:1788263424.134510:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753756032 00000100:00100000:3.0:1788263424.134517:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753756032 00000100:00100000:3.0:1788263424.134562:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788263424.134572:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753756032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263424.134803:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753756032:12345-0@lo:501:mount.lustre.0 Request processed in 231us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263424.134811:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263424.137608:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263424.137685:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263424.137757:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263424.137800:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468ad0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263424.137802:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753756160 00000100:00100000:1.0:1788263424.137810:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753756160 00000100:00100000:1.0:1788263424.137887:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788263424.137897:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753756160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263424.138101:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753756160:12345-0@lo:503:mount.lustre.0 Request processed in 203us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263424.138110:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263424.140280:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788263424.140946:0:15180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263424.141048:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263424.141110:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263424.141160:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468ad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263424.146395:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753756288 00000100:00100000:3.0:1788263424.146411:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753756288 00000100:00100000:3.0:1788263424.146478:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788263424.146488:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753756288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263424.146778:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753756288:12345-0@lo:502:mount.lustre.0 Request processed in 289us (5666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263424.146786:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263424.148465:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788263424.148820:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788263424.148879:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788263424.148927:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788263424.148988:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788263424.149024:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788263424.149075:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788263424.149112:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788263424.149145:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788263424.149186:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263424.149389:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263424.149432:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468ad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263424.153811:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753756416 00000100:00100000:3.0:1788263424.153826:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753756416 00000100:00100000:3.0:1788263424.153893:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788263424.153903:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753756416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263424.154184:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753756416:12345-0@lo:502:mount.lustre.0 Request processed in 282us (4794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263424.154192:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263424.155415:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788263424.155597:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788263424.155612:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788263424.166581:0:15198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263424.166592:0:15198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263424.166595:0:15198:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788263424.166601:0:15198:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9943744b9800 00000020:00000080:2.0:1788263424.166603:0:15198:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263424.166612:0:15198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263424.166614:0:15198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263424.166616:0:15198:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788263424.166618:0:15198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263424.166620:0:15198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263424.166622:0:15198:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788263424.166625:0:15198:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9943744b9800 00000020:00000080:2.0:1788263424.166627:0:15198:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263424.166709:0:15198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263424.166712:0:15198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263424.166714:0:15198:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788263424.166716:0:15198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263424.166724:0:15198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263424.166725:0:15198:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788263424.166728:0:15198:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9943744b9800 00000020:00000080:2.0:1788263424.166730:0:15198:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263424.166763:0:15198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263424.166765:0:15198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263424.166767:0:15198:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788263424.166770:0:15198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788263424.180035:0:15180:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788263424.180081:0:15180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263424.180111:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.180139:0:15180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263424.180321:0:15180:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788263424.180325:0:15180:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9943744b9800 10000000:01000000:1.0:1788263424.180328:0:15180:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9943744b9800 10000000:01000000:1.0:1788263424.180333:0:15180:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788263424.180339:0:15180:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9943744b9800 from 1 10000000:01000000:1.0:1788263424.180341:0:15180:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788263424.180377:0:15180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.180395:0:15180:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.180419:0:15180:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263424.180443:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788263424.180508:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263424.180554:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994355d57cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263424.180687:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753756544 00000100:00100000:0.0:1788263424.180694:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753756544 00000100:00100000:0.0:1788263424.180741:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788263424.180750:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753756544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263424.180764:0:14491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263424.180776:0:14491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994380658400/0x1a657bc513956c9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956c94 expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.180799:0:14491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380658400/0x1a657bc513956c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956c94 expref: 16 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.180810:0:14491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994380658400/0x1a657bc513956c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956c94 expref: 16 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.180819:0:14491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658400, rc 0) 00000100:00100000:0.0:1788263424.180857:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753756544:12345-0@lo:101:mount.lustre.0 Request processed in 107us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263424.180864:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788263424.181093:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263424.181107:0:15180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.181116:0:15180:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788263424.181760:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788263424.182067:0:15180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263424.182354:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788263424.182400:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788263424.182431:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788263424.182486:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788263424.182542:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788263424.182594:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788263424.182634:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788263424.182666:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788263424.182712:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788263424.182749:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788263424.182797:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788263424.182846:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788263424.182883:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788263424.182919:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788263424.182966:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788263424.183033:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788263424.183069:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788263424.183131:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788263424.183170:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788263424.183206:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788263424.183297:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788263424.183335:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788263424.183371:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788263424.183421:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788263424.183459:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788263424.183494:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788263424.183539:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788263424.183572:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788263424.183644:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788263424.183652:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788263424.183730:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263424.183785:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263424.183814:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994355d57cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263424.184251:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753756672 00000100:00100000:0.0:1788263424.184259:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753756672 00000100:00100000:0.0:1788263424.184298:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263424.184307:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753756672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263424.184540:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753756672:12345-0@lo:501:mount.lustre.0 Request processed in 233us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263424.184559:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788263424.200613:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263424.200686:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263424.200759:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263424.200792:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753756800 00000100:00100000:1.0:1788263424.200798:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753756800 00000100:00100000:1.0:1788263424.200850:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788263424.200859:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753756800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263424.201059:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753756800:12345-0@lo:503:mount.lustre.0 Request processed in 199us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263424.201067:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788263424.201115:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994355d57cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263424.201128:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788263424.201901:0:15180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788263424.201963:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263424.202017:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263424.202047:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753756928 00000100:00100000:1.0:1788263424.202051:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753756928 00000100:00100000:1.0:1788263424.202075:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263424.202082:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f559050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753756928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263424.202272:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f559050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753756928:12345-0@lo:502:mount.lustre.0 Request processed in 190us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263424.202280:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263424.202312:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263424.202326:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753756928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788263424.206104:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788263424.206187:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788263424.206254:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788263424.206307:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788263424.206364:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788263424.208073:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788263424.208154:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788263424.208190:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788263424.208270:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788263424.208312:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788263424.208359:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788263424.209663:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788263424.213690:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788263424.213731:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788263424.214335:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788263424.214385:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788263424.214445:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788263424.214496:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788263424.214534:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788263424.214568:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788263424.214636:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788263424.215301:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788263424.215347:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788263424.215469:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788263424.215512:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788263424.215547:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788263424.215611:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788263424.215655:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788263424.216563:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788263424.216629:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788263424.220818:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788263424.220934:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788263424.220986:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788263424.221061:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788263424.221098:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788263424.221146:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788263424.221212:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788263424.225806:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788263424.225891:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788263424.225931:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788263424.225995:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753757056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263424.226076:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263424.226123:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753757056 00000100:00100000:1.0:1788263424.226131:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753757056 00000100:00100000:1.0:1788263424.226174:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263424.226183:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753757056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263424.226428:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753757056:12345-0@lo:502:mount.lustre.0 Request processed in 244us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263424.226436:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263424.226910:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263424.226934:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753757056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788263424.227028:0:15180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788263424.227039:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788263424.229856:0:15203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788263424.229874:0:15203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9942421b3370) 00000020:00000080:3.0:1788263424.229898:0:15203:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788263424.230007:0:15203:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9943744b9800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788263424.230012:0:15203:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9943744b9800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788263424.230015:0:15203:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9943744b9800 3 00010000:00080000:3.0:1788263424.230044:0:15203:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9943803e4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1788263424.231692:0:15203:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788263424.239541:0:15203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788263424.239584:0:15203:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788263424.239597:0:15203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1a657bc513956ca9 00000100:00080000:2.0:1788263424.239608:0:15203:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263424.239614:0:15203:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9943803e4000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788263424.239649:0:15203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9943810d9c00 x1875129753757184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263424.239682:0:15203:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788263424.239712:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263424.239717:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263424.239719:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263424.239722:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788263424.239772:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753757312:0@lo:400:kworker.0 00000100:00100000:2.0:1788263424.239837:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263424.239885:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753757312 00000100:00100000:2.0:1788263424.239891:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753757312 00000100:00100000:2.0:1788263424.239926:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263424.239934:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753757312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263424.239994:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753757312:12345-0@lo:400:kworker.0 Request processed in 59us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263424.240014:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788263424.240054:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9943810db800 x1875129753757312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263424.240066:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753757312:0@lo:400:kworker.0 00000100:00100000:1.0:1788263424.240252:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753757184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788263424.240285:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263424.240381:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753757184 00000100:00100000:2.0:1788263424.240385:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753757184 00000100:00100000:2.0:1788263424.240443:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263424.240448:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1875129753757184:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788263424.240469:0:14498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:2.0:1788263424.240499:0:14498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1a657bc513956cb0 00000004:00100000:2.0:1788263424.240512:0:14498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788263424.240541:0:14498:0:(import.c:65:import_set_state_nolock()) ffff9943803c7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263424.240580:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875129753757184:12345-0@lo:38:llog_process_th.0 Request processed in 130us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263424.240587:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788263424.246026:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9943810d9c00 x1875129753757184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263424.246042:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263424.246053:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788263424.246061:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788263424.246067:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788263424.246070:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9943803e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263424.246078:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753757184:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788263424.255162:0:15203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788263424.255433:0:15180:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788263424.255463:0:15180:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263424.255521:0:15180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263424.255540:0:15180:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788263424.255589:0:15180:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788263424.255591:0:15180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788263424.255592:0:15180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263424.255593:0:15180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263424.255594:0:15180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263424.255595:0:15180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263424.255597:0:15180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263424.255599:0:15180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263424.255600:0:15180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263424.255619:0:15180:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788263424.255622:0:15180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788263424.255623:0:15180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788263424.255624:0:15180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263424.255625:0:15180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263424.255625:0:15180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263424.255626:0:15180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263424.255627:0:15180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263424.255628:0:15180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263424.255628:0:15180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263424.255655:0:15180:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788263424.255676:0:15180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753757440:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788263424.255742:0:15180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263424.255789:0:15180:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f18d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263424.256145:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753757440 00000100:00100000:3.0:1788263424.256155:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753757440 00000100:00100000:3.0:1788263424.256203:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788263424.256212:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15180:x1875129753757440:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788263424.256264:0:14490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788263424.256278:0:14490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788263424.321427:0:14490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788263424.321442:0:14490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788263424.321477:0:14513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788263424.321481:0:14513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788263424.321505:0:14513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.321523:0:14513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956c1d expref: 16 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.321531:0:14513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.321572:0:14513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513956c1d expref: 16 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.321588:0:14513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513956c1d expref: 16 pid: 14492 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263424.321618:0:14513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14513:1875129753757568:0@lo:104: 00000100:00100000:3.0:1788263424.321702:0:14513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263424.321762:0:14513:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263424.321787:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753757568 00000100:00100000:3.0:1788263424.321794:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753757568 00000100:00100000:3.0:1788263424.321835:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263424.321845:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+3:14513:x1875129753757568:12345-0@lo:104: 00010000:00010000:3.0:1788263424.321858:0:14481:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.321916:0:14481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263424.321922:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+3:14513:x1875129753757568:12345-0@lo:104: Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263424.321928:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788263424.321950:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263424.321956:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.321964:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:3.0:1788263424.321967:0:14486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.321987:0:14486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263424.321994:0:14486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263424.322011:0:14486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263424.322036:0:14486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.322043:0:14486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263424.322060:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.322067:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994380659a00/0x1a657bc513956c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956c24 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263424.322083:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263424.322085:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263424.322087:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263424.322099:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753757696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263424.322129:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263424.322171:0:14513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14513:1875129753757568:0@lo:104: 00010000:00010000:3.0:1788263424.322190:0:14513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263424.323003:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753757696 00000100:00100000:2.0:1788263424.323019:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753757696 00010000:00010000:2.0:1788263424.323041:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956c1d expref: 17 pid: 14492 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263424.323071:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263424.323080:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+17:3321:x1875129753757696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263424.323092:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263424.323097:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956c1d expref: 17 pid: 14492 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323108:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513956c1d expref: 17 pid: 14492 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323123:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99437f6b0600/0x1a657bc513956c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513956c1d expref: 17 pid: 14492 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323140:0:14483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323148:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788263424.323161:0:14483:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001681273s 00010000:00010000:2.0:1788263424.323165:0:14483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323171:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323178:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323194:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323200:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216c200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263424.323204:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323212:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323262:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323272:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263424.323316:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:3321:x1875129753757696:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263424.323324:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263424.323361:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753757696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263424.323441:0:14513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.323451:0:14513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263424.323457:0:14513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216c200/0x1a657bc513956cb7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263424.323768:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263424.367551:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+15:15180:x1875129753757440:12345-0@lo:253:mount.lustre.0 Request processed in 111330us (111799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263424.367567:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263424.370027:0:15180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15180:1875129753757440:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788263424.370048:0:15180:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788263424.370052:0:15180:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263424.370053:0:15180:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788263424.370054:0:15180:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263424.370055:0:15180:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263424.370056:0:15180:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263424.370058:0:15180:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263424.370059:0:15180:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263424.370061:0:15180:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263424.370062:0:15180:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788263424.370093:0:15180:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788263424.386207:0:15180:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263424.386531:0:15180:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788263424.386689:0:15180:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263424.386828:0:15180:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788263424.387048:0:15180:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263424.387330:0:15180:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788263424.388511:0:15180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788263424.564075:0:15180:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788263424.564086:0:15180:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788263424.564121:0:15180:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788263424.564177:0:15180:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788263424.564191:0:15180:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788263424.564248:0:15180:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788263425.339487:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788263425.979300:0:14494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788263425.979309:0:14494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99434660c800 from 7 10000000:01000000:2.0:1788263425.979314:0:14494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263425.979369:0:14494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263425.979381:0:14494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263425.979393:0:14494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263425.979417:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753757824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263425.979488:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263425.979555:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263425.979691:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753757824 00000100:00100000:1.0:1788263425.979700:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753757824 00000100:00100000:1.0:1788263425.979761:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788263425.979771:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+15:14494:x1875129753757824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263425.979785:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263425.979798:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956cbe expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263425.979822:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956cbe expref: 16 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263425.979832:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956cbe expref: 16 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263425.979873:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0e00, rc 0) 00000100:00100000:1.0:1788263425.979916:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+16:14494:x1875129753757824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263425.979923:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263425.980125:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753757824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263425.980142:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263425.980151:0:14494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263425.980205:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753757952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788263425.980290:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263425.980310:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788263425.981030:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753757952 00000100:00100000:1.0:1788263425.981037:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753757952 00000100:00100000:1.0:1788263425.981065:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788263425.981073:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+16:14494:x1875129753757952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788263425.981091:0:14490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263425.981108:0:14490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263425.981111:0:14490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788263425.981197:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+16:14494:x1875129753757952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263425.981205:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788263425.981331:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753757952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788263425.981389:0:14494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263425.981397:0:14494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263425.981406:0:14494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.366422:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263427.388654:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263428.411361:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263429.375425:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753758080:0@lo:400:kworker.0 00000100:00100000:1.0:1788263429.375505:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263429.375657:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753758080 00000100:00100000:0.0:1788263429.375667:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753758080 00000100:00100000:0.0:1788263429.375718:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263429.375727:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:3322:x1875129753758080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788263429.376000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263429.376015:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263429.376018:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263429.376021:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788263429.376070:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753758208:0@lo:400:kworker.0 00000100:00100000:2.0:1788263429.376103:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263429.376155:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753758208 00000100:00100000:2.0:1788263429.376160:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753758208 00000100:00100000:2.0:1788263429.376190:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263429.376198:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753758208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263429.376257:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753758208:12345-0@lo:400:kworker.0 Request processed in 60us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263429.376264:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788263429.376304:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437630d180 x1875129753758208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263429.376318:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753758208:0@lo:400:kworker.0 00000100:00100000:0.0:1788263429.376977:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:3322:x1875129753758080:12345-0@lo:400:kworker.0 Request processed in 1248us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263429.376989:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263429.377250:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263429.377442:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753758336:0@lo:400:kworker.0 00000100:00100000:0.0:1788263429.377479:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263429.377601:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753758080:0@lo:400:kworker.0 00000100:00100000:2.0:1788263429.381014:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753758336 00000100:00100000:2.0:1788263429.381029:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753758336 00000100:00100000:0.0:1788263429.381980:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263429.381994:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753758336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263429.382086:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753758336:12345-0@lo:400:kworker.0 Request processed in 97us (4607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263429.382094:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788263429.382158:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437630ed80 x1875129753758336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263429.382175:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753758336:0@lo:400:kworker.0 00000100:00080000:3.0:1788263429.383463:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788263429.437391:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263430.459438:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263431.483722:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263431.947014:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788263432.513999:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788263433.329573:0:15548:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788263433.534050:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263434.491441:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263434.491450:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788263434.491454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263434.491457:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788263434.491510:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263434.491538:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753758464:0@lo:400:kworker.0 00000100:00100000:0.0:1788263434.491637:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263434.491931:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753758592:0@lo:400:kworker.0 00000100:00100000:0.0:1788263434.491966:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263434.492000:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263434.492006:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753758720:0@lo:400:kworker.0 00000100:00100000:0.0:1788263434.492029:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263434.492080:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753758464 00000100:00100000:0.0:1788263434.492089:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753758464 00000100:00100000:0.0:1788263434.492145:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788263434.492156:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+16:3320:x1875129753758464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263434.492213:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+16:3320:x1875129753758464:12345-0@lo:400:kworker.0 Request processed in 58us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263434.492258:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788263434.492295:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753758592 00000100:00100000:0.0:1788263434.492299:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753758592 00000100:00100000:0.0:1788263434.492326:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753758720 00000100:00100000:0.0:1788263434.492330:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753758720 00000100:00100000:0.0:1788263434.492359:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263434.492367:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753758592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263434.492403:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753758592:12345-0@lo:400:kworker.0 Request processed in 38us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263434.492409:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263434.492420:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263434.492426:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753758720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263434.492452:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753758720:12345-0@lo:400:kworker.0 Request processed in 26us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263434.492457:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788263434.492481:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788263434.492511:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994347206d80 x1875129753758720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263434.492526:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347206d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753758720:0@lo:400:kworker.0 00010000:00080000:0.0:1788263434.492537:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994347204700 x1875129753758592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263434.492559:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753758592:0@lo:400:kworker.0 00000100:00100000:0.0:1788263434.492596:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753758464:0@lo:400:kworker.0 00000100:00100000:3.0:1788263434.494682:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263419/real 1788263419] req@ffff99437f50b480 x1875129753754624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263434 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263434.494718:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99437f50b480 x1875129753754624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263434 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263434.494728:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263419/real 1788263419] req@ffff99437f50a680 x1875129753754752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263434 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263434.494740:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99437f50a680 x1875129753754752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263434 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788263434.494760:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99434646c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263434.494789:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788263434.494803:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753754624:0@lo:8:kworker.0 00000100:00080000:3.0:1788263434.494809:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263434.494815:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788263434.494818:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753754752:0@lo:8:kworker.0 00000100:00080000:1.0:1788263434.498415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263434.498430:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788263434.498435:0:8:0:(import.c:65:import_set_state_nolock()) ffff99434646c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263434.498446:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:1.0:1788263434.498454:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788263434.498463:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99434646c800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263434.498515:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437f509f80 x1875129753758848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788263434.498553:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263434.498557:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788263434.498559:0:8:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263434.498563:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:1.0:1788263434.498566:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788263434.498569:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99437fb70800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263434.498583:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437f50b100 x1875129753758976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263434.498624:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753758848:0@lo:8:kworker.0 00000100:00100000:1.0:1788263434.498716:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263434.498783:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f50b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753758976:0@lo:8:kworker.0 00000100:00100000:1.0:1788263434.498818:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263434.498874:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753758848 00000100:00100000:1.0:1788263434.498883:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753758848 00000100:00100000:1.0:1788263434.498916:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753758976 00000100:00100000:1.0:1788263434.498919:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753758976 00000100:00100000:1.0:1788263434.498935:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263434.498945:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3319:x1875129753758848:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788263434.498978:0:15183:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1788263434.499013:0:15183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513956ccc 00002000:00100000:1.0:1788263434.499031:0:15183:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9943803eb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788263434.499036:0:15183:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788263434.499039:0:15183:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788263434.499461:0:15183:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788263434.499499:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9943803eb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263434.499559:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875129753758848:12345-0@lo:8:kworker.0 Request processed in 614us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263434.499567:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263434.499589:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263434.499594:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3319:x1875129753758976:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788263434.499607:0:15183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788263434.499635:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3319:x1875129753758976:12345-0@lo:8:kworker.0 Request processed in 40us (816us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788263434.499641:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788263434.499679:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437f509f80 x1875129753758848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263434.499692:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788263434.499701:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788263434.499710:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788263434.499715:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788263434.499718:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99434646c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788263434.506130:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788263434.506158:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753758848:0@lo:8:kworker.0 00000100:00080000:1.0:1788263434.506233:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263434.506241:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788263434.506245:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f50b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753758976:0@lo:8:kworker.0 00000004:00080000:3.0:1788263434.507128:0:14519:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788263434.507567:0:14519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 461295347930ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788263434.513551:0:14520:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788263434.513589:0:14520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14520:1875129753759232:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788263434.513678:0:14520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263434.513715:0:14520:0:(client.c:2715:ptlrpc_set_wait()) set ffff99436de113c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263434.513745:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263434.513759:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753759104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263434.513788:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263434.513838:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753759232 00000100:00100000:0.0:1788263434.513847:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753759232 00000100:00100000:0.0:1788263434.513914:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263434.513925:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14520:x1875129753759232:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788263434.516386:0:15183:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788263434.516399:0:15183:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788263434.516405:0:15183:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:2.0:1788263434.517890:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753759104 00000100:00100000:2.0:1788263434.517909:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753759104 00000100:00100000:2.0:1788263434.517974:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263434.517987:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753759104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263434.518038:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263434.518151:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753759104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (4361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263434.518176:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788263434.518202:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1788263434.547982:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.547995:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.548011:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.548016:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.548022:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.548051:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.548061:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.548069:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.548086:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788263434.550180:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.550190:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.550203:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.550239:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.550246:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.550262:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788263434.550374:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994347204380 x1875129753759104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263434.550410:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753759104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263434.550418:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.550444:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.550568:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788263434.551317:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263434.555690:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.555708:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.555714:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.555740:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.555773:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.555781:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513956cd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.555943:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.555947:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.555954:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.555957:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.555965:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.557952:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.557961:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc513956cda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.558003:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.558006:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.558010:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263434.559330:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.559343:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.559363:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.559368:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.559375:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.559389:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.559400:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.559409:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.559433:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263434.560964:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.560982:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.560998:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.561004:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.561017:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.561039:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.561047:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513956ce1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.561104:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.561106:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.561108:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263434.564158:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.564176:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.564204:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.564209:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.564245:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.564264:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.564277:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.564287:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.564318:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263434.564623:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.564632:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.564641:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.564646:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.564657:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.564676:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.564684:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513956ce8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.564706:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.564708:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.564710:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.565291:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263434.566376:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.566390:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.566409:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.566415:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.566422:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.567662:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263434.568003:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.568046:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.568055:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.568076:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788263434.569333:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.569346:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.569363:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.569368:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.569375:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.569389:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.569399:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.569409:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.569456:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788263434.575467:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.575484:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.575508:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.575513:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.575520:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.575537:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.575549:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.575558:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.575570:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788263434.576173:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.576182:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576192:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.576200:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.576205:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576251:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576259:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576268:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576277:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788263434.576634:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.576640:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576649:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.576652:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.576656:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576666:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576675:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576686:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.576707:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1788263434.577272:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788263434.577283:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577300:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.577305:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577316:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577338:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577346:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513956cef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577371:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788263434.577375:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577381:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.577384:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577393:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577401:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577412:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d095fcac/0x1a657bc513956cf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577424:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788263434.577427:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577433:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.577498:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577507:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577518:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577525:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8deca92/0x1a657bc513956cfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577537:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263434.577540:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577547:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.577556:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577564:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577573:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577580:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513956d04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577590:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.577594:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577601:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.577604:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577611:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577618:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577625:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513956d0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.577643:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.577644:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.577646:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263434.584867:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.584885:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.584908:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.584915:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.584922:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.584939:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.584952:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.584961:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.584993:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263434.585153:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263434.585160:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.585179:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263434.585185:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.585195:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.585251:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.585260:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513956d12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.585283:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263434.585285:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263434.585286:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263434.585293:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263434.590325:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.590347:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.590368:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.590374:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.590382:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.590414:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.590427:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.590450:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.590477:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263434.594622:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263434.594640:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.594657:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263434.594663:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.594676:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.594722:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.594732:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc513956d19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.594767:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263434.594770:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263434.594772:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263434.596205:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263434.596246:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.596265:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=461s v=(0 0) 00010000:00010000:0.0:1788263434.596270:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263434.596277:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.596294:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.596306:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.596330:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.596421:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263434.597059:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263434.597070:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.597082:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263434.597088:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.597098:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.597119:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.597126:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513956d20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.597153:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263434.597156:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263434.597158:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263434.597606:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263434.597618:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.597635:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788263434.597639:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263434.597646:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.597662:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.597672:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.597680:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.597716:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263434.597734:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.597739:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.598584:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.598589:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.598599:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.598616:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.598622:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7957e85/0x1a657bc513956d27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.598643:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.598644:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.598647:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263434.600033:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263434.600043:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600056:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788263434.600060:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263434.600067:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600080:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600098:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600106:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600137:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788263434.600707:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263434.600714:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600723:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788263434.600726:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263434.600731:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600740:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600748:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600756:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600786:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788263434.600813:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263434.600819:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600826:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216c600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.600831:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600840:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600854:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600862:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc443c88/0x1a657bc513956d2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600879:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.600883:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600889:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.600892:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600912:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600924:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600930:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6150884/0x1a657bc513956d35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.600942:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.600943:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.600946:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263434.601368:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263434.601374:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601383:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788263434.601386:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263434.601390:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601400:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601408:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601421:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601435:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263434.601444:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.601446:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601453:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.601456:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601464:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601474:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601481:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edec6f0e/0x1a657bc513956d3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.601494:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.601496:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.601497:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263434.602873:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263434.607033:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263434.607060:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607077:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788263434.607082:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263434.607088:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607103:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607114:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607122:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607147:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263434.607165:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.607171:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607179:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.607184:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607192:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607249:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607258:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001580586d/0x1a657bc513956d43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.607295:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.607301:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.607306:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263434.609678:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263434.609700:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.609717:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1788263434.609721:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263434.609728:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.610688:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.610706:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.610714:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.612305:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263434.612334:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263434.612350:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.612366:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216c200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263434.612374:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.612397:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.612482:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.612491:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023dae728/0x1a657bc513956d4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.612523:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263434.612524:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263434.612526:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263434.614252:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263434.614267:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.615075:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788263434.615079:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263434.615086:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.615103:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.615114:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.615121:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.615375:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263434.615385:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263434.615403:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.615423:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263434.615430:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.615442:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.615469:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.615501:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.615532:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263434.615534:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263434.615536:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263434.621711:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263434.621726:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.624224:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788263434.624255:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263434.624265:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.625289:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.625303:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.625311:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.625333:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263434.626919:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.626931:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.626942:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.626947:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.626957:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.626976:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.626983:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.627008:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.627010:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.627012:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263434.627806:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263434.627815:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.628195:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788263434.628201:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263434.628208:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.628244:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.628254:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.628270:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.628294:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263434.630168:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.630180:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.630192:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.630207:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.630248:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.630281:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.630290:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.630312:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.630314:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.630316:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263434.633122:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263434.633148:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.633167:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788263434.633171:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263434.633178:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.633192:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.633203:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.633210:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.633268:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263434.635443:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263434.635455:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.635485:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263434.635490:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.635501:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.635526:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.635534:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.635559:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263434.635561:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263434.635563:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263434.682975:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263434.682991:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.683008:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788263434.683013:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263434.683019:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.683034:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.683052:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.683061:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.683091:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263434.684118:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263434.684128:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.684350:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788263434.684355:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263434.684361:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.684374:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.684384:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.684392:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.684429:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788263434.684592:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263434.684609:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684631:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263434.684638:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684651:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684676:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684684:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a002d33/0x1a657bc513956d6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684709:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263434.684714:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684720:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263434.684724:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684732:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684742:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684759:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513956d74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263434.684772:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263434.684774:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263434.684776:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263434.687572:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263434.687587:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.687606:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788263434.687611:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263434.687618:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.687633:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.687644:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.688032:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.688061:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263434.688079:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263434.688085:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.688092:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263434.688107:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.688118:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.688756:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263434.689974:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.689991:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6bbcbc/0x1a657bc513956d7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.690020:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263434.690022:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263434.690024:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263434.691537:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263434.691548:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.691563:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788263434.691568:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263434.691574:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.691587:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.691597:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.691611:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.691637:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263434.693602:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263434.693621:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.693638:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263434.693644:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.693655:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.693681:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.693688:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007be17916/0x1a657bc513956d82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263434.693713:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263434.693715:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263434.693729:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263434.704404:0:15183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263434.704424:0:15183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.704441:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788263434.704446:0:15183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263434.706044:0:15183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.706074:0:15183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.706087:0:15183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.706096:0:15183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263434.706436:0:15183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788263434.708247:0:15183:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1788263434.708364:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14520:x1875129753759232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 194435us (194680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263434.708386:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788263434.714563:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263434.714584:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.714601:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263434.714608:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.714622:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.714651:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.714679:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad02705a/0x1a657bc513956d89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263434.714707:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.714709:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263434.714711:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263434.715695:0:14520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14520:1875129753759232:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788263434.715717:0:14520:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788263434.715783:0:14520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14520:1875129753759360:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788263434.716770:0:14520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263434.716853:0:14520:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349852240 going to sleep for 11 seconds 00000100:00100000:3.0:1788263434.716941:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753759360 00000100:00100000:3.0:1788263434.716951:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753759360 00000100:00100000:3.0:1788263434.717038:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263434.717054:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14520:x1875129753759360:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788263434.717119:0:15184:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:3.0:1788263434.725344:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788263434.766090:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14520:x1875129753759360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 49030us (49315us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788263434.766110:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263434.766499:0:14520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14520:1875129753759360:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788263434.766520:0:14520:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:0.0:1788263435.138327:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788263435.138463:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788263435.579393:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263436.616306:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263437.627507:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263438.651595:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788263439.620718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263439.620738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788263439.620743:0:37:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263439.620754:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:3.0:1788263439.620761:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788263439.620770:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99437fb70800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263439.620798:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437630fb80 x1875129753759744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263439.620855:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753760000:0@lo:400:kworker.0 00000100:00100000:3.0:1788263439.620951:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263439.621025:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263439.621044:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753759488:0@lo:400:kworker.0 00000100:00100000:3.0:1788263439.621079:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263439.621959:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753759744:0@lo:8:kworker.0 00000100:00100000:1.0:1788263439.622013:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263439.622457:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753759616:0@lo:400:kworker.0 00000100:00100000:0.0:1788263439.622501:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753759872:0@lo:400:kworker.0 00000100:00100000:0.0:1788263439.622530:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263439.622587:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753760000 00000100:00100000:0.0:1788263439.622596:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753760000 00000100:00100000:0.0:1788263439.622672:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753759872 00000100:00100000:0.0:1788263439.622676:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753759872 00000100:00100000:0.0:1788263439.622696:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263439.622718:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753760000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263439.623094:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753760000:12345-0@lo:400:kworker.0 Request processed in 378us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263439.623103:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263439.623124:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263439.623131:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753759872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263439.623166:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753759872:12345-0@lo:400:kworker.0 Request processed in 35us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263439.623172:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263439.623194:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753759488 00000100:00100000:0.0:1788263439.623198:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753759488 00000100:00100000:0.0:1788263439.623291:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788263439.623299:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:3320:x1875129753759488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263439.623333:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:3320:x1875129753759488:12345-0@lo:400:kworker.0 Request processed in 36us (2253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263439.623339:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788263439.623388:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788263439.623426:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437630f100 x1875129753759872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263439.623443:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753759872:0@lo:400:kworker.0 00000100:00100000:0.0:1788263439.623502:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753759488:0@lo:400:kworker.0 00010000:00080000:0.0:1788263439.623515:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437630df80 x1875129753760000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263439.623525:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753760000:0@lo:400:kworker.0 00000100:00100000:0.0:1788263439.623541:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263439.623556:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347207800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753760128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263439.623585:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263439.623697:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753760128 00000100:00100000:0.0:1788263439.623712:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753760128 00000100:00100000:0.0:1788263439.623850:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263439.623858:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753760128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263439.623896:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263439.623937:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753760128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263439.623943:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788263439.623958:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263439.623978:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788263439.623998:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347207800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753760128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263439.629696:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263439.629784:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753759744 00000100:00100000:0.0:1788263439.629795:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753759744 00000100:00100000:0.0:1788263439.629829:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753759616 00000100:00100000:0.0:1788263439.629831:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753759616 00000100:00100000:0.0:1788263439.629862:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263439.629873:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753759616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263439.629963:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753759616:12345-0@lo:400:kworker.0 Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263439.629972:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263439.629989:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263439.629994:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753759744:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788263439.630014:0:15182:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788263439.635941:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753759616:0@lo:400:kworker.0 00000100:00100000:3.0:1788263439.668077:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753759744:12345-0@lo:8:kworker.0 Request processed in 38073us (46054us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788263439.668094:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788263439.668304:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263439.668329:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788263439.668334:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753759744:0@lo:8:kworker.0 00010000:00010000:1.0:1788263439.678266:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263440.703237:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263441.150039:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788263441.724068:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263441.980598:0:15900:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263441.980604:0:15900:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788263441.980762:0:15900:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9943803c6000 00000020:01000004:2.0:1788263441.980782:0:15900:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788263441.980799:0:15900:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788263441.980838:0:15900:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff994243878000) 00000020:00000080:2.0:1788263441.980858:0:15900:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788263442.023001:0:15900:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788263442.023391:0:15900:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788263442.024512:0:15900:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788263442.024836:0:15900:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788263442.025068:0:15900:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788263442.025533:0:15900:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 523: rc = 0 00100000:10000000:3.0:1788263442.025716:0:15900:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 523: rc = 0 00100000:10000000:3.0:1788263442.025810:0:15900:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 523: rc = 0 00100000:10000000:3.0:1788263442.026270:0:15900:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1788263442.026717:0:15900:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788263442.026965:0:15900:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1788263442.027273:0:15900:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:3.0:1788263442.027536:0:15900:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1788263442.027875:0:15900:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00000020:00000080:3.0:1788263442.028636:0:15900:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788263442.028653:0:15900:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788263442.028678:0:15900:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1a657bc513956d97 00000020:01000004:3.0:1788263442.028690:0:15900:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788263442.028719:0:15900:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788263442.028723:0:15900:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788263442.028731:0:15900:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788263442.028762:0:15900:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788263442.028774:0:15900:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788263442.037433:0:15900:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788263442.037485:0:15900:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788263442.037490:0:15900:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788263442.037492:0:15900:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263442.037493:0:15900:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263442.037494:0:15900:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263442.037496:0:15900:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263442.037497:0:15900:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263442.037499:0:15900:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263442.037501:0:15900:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263442.037503:0:15900:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263442.037507:0:15900:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788263442.037510:0:15900:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263442.037511:0:15900:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263442.037512:0:15900:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263442.037514:0:15900:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263442.037515:0:15900:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263442.037516:0:15900:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263442.037517:0:15900:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263442.037518:0:15900:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263442.037518:0:15900:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263442.037641:0:15900:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788263442.037677:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760256:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788263442.037780:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.037928:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263442.037932:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753760256 00000100:00100000:0.0:1788263442.037943:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753760256 00000100:00100000:0.0:1788263442.038022:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263442.038034:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15900:x1875129753760256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788263442.038091:0:14490:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788263442.038094:0:14490:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788263442.038099:0:14490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788263442.063144:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15900:x1875129753760256:12345-0@lo:253:mount.lustre.0 Request processed in 25098us (25351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.063163:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788263442.063491:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760256:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788263442.063516:0:15900:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788263442.063521:0:15900:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788263442.063523:0:15900:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788263442.063524:0:15900:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263442.063526:0:15900:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263442.063527:0:15900:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263442.063529:0:15900:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263442.063531:0:15900:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263442.063534:0:15900:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263442.063535:0:15900:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788263442.063871:0:15900:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9943803c6000 from lustre-OST0001 10000000:01000000:1.0:1788263442.063916:0:15900:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788263442.063920:0:15900:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788263442.063933:0:15900:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994346b34d28 local copy 00010000:00010000:1.0:1788263442.063947:0:15900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263442.064501:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263442.064694:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.065081:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263442.065152:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753760384 00000100:00100000:0.0:1788263442.065161:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753760384 00000100:00100000:2.0:1788263442.065466:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788263442.065481:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943820c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15900:x1875129753760384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263442.066627:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943820c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15900:x1875129753760384:12345-0@lo:501:mount.lustre.0 Request processed in 1134us (1918us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788263442.066640:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788263442.067081:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760384:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788263442.067114:0:15900:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788263442.067505:0:15900:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788263442.067518:0:15900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.067540:0:15900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263442.067713:0:15900:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9943803c6000 10000000:01000000:3.0:1788263442.067720:0:15900:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788263442.067728:0:15900:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788263442.067731:0:15900:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263442.067737:0:15900:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788263442.067741:0:15900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788263442.067900:0:15900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.067911:0:15900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.067927:0:15900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263442.068026:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263442.068103:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.068259:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372309300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263442.068358:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753760512 00000100:00100000:1.0:1788263442.068368:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753760512 00000100:00100000:0.0:1788263442.068514:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788263442.068530:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+16:15900:x1875129753760512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263442.068546:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263442.068573:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994380659000/0x1a657bc513956da5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956d9e expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263442.068606:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380659000/0x1a657bc513956da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956d9e expref: 17 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263442.070533:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994380659000/0x1a657bc513956da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956d9e expref: 17 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263442.070554:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659000, rc 0) 00000100:00100000:0.0:1788263442.070783:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753760512:12345-0@lo:101:mount.lustre.0 Request processed in 2255us (2677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263442.070793:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788263442.071004:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263442.071032:0:15900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.071043:0:15900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263442.073517:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788263442.088198:0:15900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263442.089425:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788263442.089483:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788263442.089519:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788263442.089570:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788263442.089607:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788263442.089642:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788263442.089724:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788263442.089733:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788263442.089868:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263442.089954:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263442.090002:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff994352af4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263442.092281:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753760640 00000100:00100000:0.0:1788263442.092319:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753760640 00000100:00100000:0.0:1788263442.092394:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788263442.092405:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753760640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263442.093304:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753760640:12345-0@lo:501:mount.lustre.0 Request processed in 898us (3347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263442.093314:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263442.093912:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263442.093988:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263442.094063:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.102758:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753760768 00000100:00100000:1.0:1788263442.102780:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753760768 00000100:00100000:2.0:1788263442.102919:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff994352af4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263442.105342:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788263442.105372:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753760768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263442.105896:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753760768:12345-0@lo:503:mount.lustre.0 Request processed in 539us (11831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263442.105905:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788263442.106120:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788263442.107085:0:15900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263442.107197:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263442.107316:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.107479:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff994380c86600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263442.107566:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753760896 00000100:00100000:0.0:1788263442.107575:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753760896 00000100:00100000:0.0:1788263442.107633:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788263442.107644:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753760896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263442.107910:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753760896:12345-0@lo:502:mount.lustre.0 Request processed in 268us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263442.107919:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788263442.107946:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753760896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263442.108210:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788263442.108539:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788263442.108588:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788263442.110179:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788263442.110297:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788263442.110338:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788263442.110908:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788263442.111163:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788263442.111261:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788263442.111345:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263442.111488:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.111558:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372309300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263442.111856:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753761024 00000100:00100000:0.0:1788263442.111871:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753761024 00000100:00100000:0.0:1788263442.111962:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788263442.111974:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753761024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263442.112356:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753761024:12345-0@lo:502:mount.lustre.0 Request processed in 373us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263442.112366:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788263442.112834:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263442.112983:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788263442.112999:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788263442.131749:0:15901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788263442.131765:0:15901:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788263442.131864:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263442.131868:0:15901:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788263442.131877:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263442.131910:0:15901:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff994346b319b8) 00000020:00000080:1.0:1788263442.132059:0:15901:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788263442.132070:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788263442.132537:0:15901:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9943803c6000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788263442.132550:0:15901:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788263442.132564:0:15901:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1a657bc513956db3 00010000:00010000:1.0:1788263442.144880:0:15901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788263442.146041:0:15901:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788263442.154359:0:15901:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788263442.164453:0:15901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788263442.164473:0:15901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263442.164482:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263442.164484:0:15901:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788263442.164489:0:15901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263442.164493:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263442.164494:0:15901:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263442.164497:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263442.164500:0:15901:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788263442.164502:0:15901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263442.164505:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263442.164507:0:15901:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788263442.164509:0:15901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263442.164512:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263442.164513:0:15901:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788263442.164517:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788263442.164604:0:15901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263442.164608:0:15901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263442.164609:0:15901:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788263442.164613:0:15901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788263442.165446:0:15900:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788263442.165483:0:15900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788263442.165508:0:15900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.165523:0:15900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263442.165552:0:15900:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9943803c6000 from 1 10000000:01000000:1.0:1788263442.165556:0:15900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263442.165624:0:15900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.165633:0:15900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.165647:0:15900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263442.165690:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788263442.165780:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.165830:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263442.166755:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753761152 00000100:00100000:0.0:1788263442.166768:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753761152 00000100:00100000:0.0:1788263442.166835:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788263442.166848:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+17:15900:x1875129753761152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263442.166868:0:14491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263442.167469:0:14491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956dba expref: -99 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263442.167508:0:14491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956dba expref: 18 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263442.167522:0:14491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956dba expref: 18 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263442.167532:0:14491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658c00, rc 0) 00000100:00100000:0.0:1788263442.168006:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761152:12345-0@lo:101:mount.lustre.0 Request processed in 1157us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263442.168016:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788263442.168293:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263442.168317:0:15900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.168329:0:15900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788263442.170072:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788263442.170756:0:15900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263442.174158:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788263442.174282:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788263442.174376:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788263442.174386:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788263442.174517:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263442.174628:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.174688:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454db480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263442.174851:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753761280 00000100:00100000:2.0:1788263442.174862:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753761280 00000100:00100000:2.0:1788263442.174918:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788263442.174930:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263442.175256:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761280:12345-0@lo:501:mount.lustre.0 Request processed in 327us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263442.175266:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788263442.176367:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263442.176433:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263442.176497:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.176544:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263442.177529:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753761408 00000100:00100000:0.0:1788263442.177541:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753761408 00000100:00100000:0.0:1788263442.177603:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788263442.177616:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761408:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263442.178307:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761408:12345-0@lo:503:mount.lustre.0 Request processed in 689us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263442.178318:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788263442.180131:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761408:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788263442.181604:0:15900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788263442.181734:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263442.183018:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.183082:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375fdd240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263442.183233:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753761536 00000100:00100000:0.0:1788263442.183245:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753761536 00000100:00100000:0.0:1788263442.183311:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788263442.183323:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263442.183666:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761536:12345-0@lo:502:mount.lustre.0 Request processed in 336us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263442.183676:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788263442.183801:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263442.184100:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788263442.184164:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788263442.184210:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788263442.184292:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788263442.184325:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788263442.184376:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788263442.184412:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788263442.184446:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788263442.184505:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263442.184564:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.184607:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942420e6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263442.184927:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753761664 00000100:00100000:1.0:1788263442.184936:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753761664 00000100:00100000:1.0:1788263442.184989:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788263442.184999:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263442.185204:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761664:12345-0@lo:502:mount.lustre.0 Request processed in 205us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263442.185212:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788263442.185981:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263442.186134:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788263442.186149:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788263442.188288:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263442.188305:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263442.188309:0:15906:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788263442.188319:0:15906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9943803c6000 00000020:00000080:3.0:1788263442.188321:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263442.188330:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263442.188333:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263442.188335:0:15906:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788263442.188338:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263442.188340:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263442.188342:0:15906:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788263442.188345:0:15906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9943803c6000 00000020:00000080:3.0:1788263442.188347:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263442.188927:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263442.188933:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263442.188935:0:15906:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788263442.188938:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263442.188941:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263442.188943:0:15906:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788263442.188946:0:15906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9943803c6000 00000020:00000080:3.0:1788263442.188949:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263442.189000:0:15906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263442.189004:0:15906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263442.189005:0:15906:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788263442.189009:0:15906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788263442.201773:0:15900:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788263442.201837:0:15900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263442.201868:0:15900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.201886:0:15900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263442.202003:0:15900:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788263442.202007:0:15900:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9943803c6000 10000000:01000000:1.0:1788263442.202011:0:15900:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9943803c6000 10000000:01000000:1.0:1788263442.202016:0:15900:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788263442.202023:0:15900:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9943803c6000 from 1 10000000:01000000:1.0:1788263442.202026:0:15900:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788263442.202077:0:15900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.202087:0:15900:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.202101:0:15900:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263442.202137:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788263442.202251:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.202302:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753761792 00000100:00100000:1.0:1788263442.202311:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753761792 00000100:00100000:1.0:1788263442.202366:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788263442.202378:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753761792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263442.202393:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263442.202407:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99437f6b1400/0x1a657bc513956dcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956dc8 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.202435:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99437f6b1400/0x1a657bc513956dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956dc8 expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.202460:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99437f6b1400/0x1a657bc513956dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956dc8 expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.202472:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b1400, rc 0) 00000100:00100000:1.0:1788263442.202511:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753761792:12345-0@lo:101:mount.lustre.0 Request processed in 135us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263442.202519:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788263442.202573:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a6a5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263442.202600:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263442.202616:0:15900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.202627:0:15900:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788263442.203366:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788263442.203925:0:15900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263442.204204:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788263442.204284:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788263442.204323:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788263442.204373:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788263442.204412:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788263442.204463:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788263442.204496:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788263442.204523:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788263442.204560:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788263442.204593:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788263442.204627:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788263442.211554:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788263442.211653:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788263442.211707:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788263442.211759:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788263442.211824:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788263442.211865:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788263442.211919:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788263442.211957:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788263442.211992:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788263442.212045:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788263442.212083:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788263442.212114:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788263442.212169:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788263442.212205:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788263442.213705:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788263442.213793:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788263442.213830:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788263442.213863:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788263442.213933:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788263442.214968:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788263442.215041:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788263442.215077:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788263442.215141:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788263442.215179:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788263442.217453:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788263442.217586:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788263442.217721:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788263442.217730:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788263442.217880:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263442.217976:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.218736:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a6a5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263442.229821:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753761920 00000100:00100000:3.0:1788263442.229848:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753761920 00000100:00100000:3.0:1788263442.229928:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788263442.229942:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753761920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263442.230369:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753761920:12345-0@lo:501:mount.lustre.0 Request processed in 429us (12392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.230379:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263442.231325:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753761920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263442.231412:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753762048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263442.231485:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263442.231535:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435285a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263442.231875:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753762048 00000100:00100000:2.0:1788263442.231884:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753762048 00000100:00100000:2.0:1788263442.231935:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788263442.231944:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753762048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263442.233261:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753762048:12345-0@lo:503:mount.lustre.0 Request processed in 1312us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263442.233273:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263442.233454:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753762048:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788263442.235285:0:15900:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263442.235404:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753762176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263442.235508:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263442.235567:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435285a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263442.239851:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753762176 00000100:00100000:2.0:1788263442.239875:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753762176 00000100:00100000:2.0:1788263442.239966:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788263442.239980:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753762176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263442.240907:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753762176:12345-0@lo:502:mount.lustre.0 Request processed in 925us (5395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263442.240919:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788263442.246421:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753762176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788263442.247036:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788263442.247114:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788263442.247148:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788263442.247209:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788263442.251274:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788263442.251387:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788263442.251428:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788263442.251463:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788263442.251515:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788263442.251552:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788263442.251587:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788263442.251679:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788263442.251715:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788263442.251746:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788263442.251804:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788263442.251842:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788263442.251876:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788263442.251924:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788263442.251958:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788263442.251990:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788263442.252039:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788263442.252075:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788263442.252111:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788263442.252161:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788263442.252198:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788263442.252265:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788263442.252316:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788263442.252374:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788263442.252411:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788263442.252464:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788263442.252502:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788263442.252534:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788263442.252581:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788263442.252630:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788263442.252679:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788263442.252725:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788263442.252757:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788263442.252785:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788263442.252832:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788263442.252868:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788263442.252941:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753762304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263442.253057:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.253125:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a6a5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263442.258251:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753762304 00000100:00100000:3.0:1788263442.258274:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753762304 00000100:00100000:3.0:1788263442.258370:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788263442.258383:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753762304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263442.259051:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753762304:12345-0@lo:502:mount.lustre.0 Request processed in 667us (5991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.259062:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788263442.260493:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753762304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788263442.260764:0:15900:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788263442.260897:0:15900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788263442.285690:0:15911:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788263442.285715:0:15911:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99424387cd28) 00000020:00000080:2.0:1788263442.285747:0:15911:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788263442.286068:0:15911:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9943803c6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263442.286075:0:15911:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9943803c6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263442.286078:0:15911:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9943803c6000 3 00010000:00080000:2.0:1788263442.286117:0:15911:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9943803e9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1788263442.292982:0:15911:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788263442.306601:0:15911:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788263442.306706:0:15911:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788263442.306733:0:15911:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1a657bc513956ddd 00000100:00080000:2.0:1788263442.306748:0:15911:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263442.306755:0:15911:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9943803e9000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788263442.306838:0:15911:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9943810d9880 x1875129753762432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263442.306875:0:15911:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788263442.307618:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263442.307623:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788263442.307626:0:8:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263442.307631:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:3.0:1788263442.307636:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788263442.307641:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99437fb70800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263442.307672:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437630c380 x1875129753762688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263442.307746:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753762560:0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.307847:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.307940:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263442.307946:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753762816:0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.307988:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.308025:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753762944:0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.308051:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.308097:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753762560 00000100:00100000:3.0:1788263442.308107:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753762560 00000100:00100000:3.0:1788263442.308177:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263442.308188:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753762560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.308271:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753762560:12345-0@lo:400:kworker.0 Request processed in 84us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.308278:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263442.308312:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753762816 00000100:00100000:3.0:1788263442.308316:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753762816 00000100:00100000:3.0:1788263442.308342:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753762944 00000100:00100000:3.0:1788263442.308345:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753762944 00000100:00100000:3.0:1788263442.308361:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263442.308367:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753762816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.308398:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753762816:12345-0@lo:400:kworker.0 Request processed in 32us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.308404:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263442.308415:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788263442.308421:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753762944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.308449:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753762944:12345-0@lo:400:kworker.0 Request processed in 29us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.308454:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788263442.308477:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263442.308483:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788263442.308523:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437630fb80 x1875129753762944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263442.308549:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753762944:0@lo:400:kworker.0 00010000:00080000:3.0:1788263442.308587:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99437630d880 x1875129753762816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263442.308597:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753762816:0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.308606:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753762560:0@lo:400:kworker.0 00000100:00100000:0.0:1788263442.309537:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753762432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788263442.309605:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263442.309682:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753762688:0@lo:8:kworker.0 00000100:00100000:0.0:1788263442.309717:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263442.309760:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753762688 00000100:00100000:0.0:1788263442.309768:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753762688 00000100:00100000:0.0:1788263442.309817:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263442.309825:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753762688:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788263442.309910:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753762688:12345-0@lo:8:kworker.0 Request processed in 83us (191us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788263442.309926:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263442.309963:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263442.309972:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263442.309976:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788263442.309980:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753762688:0@lo:8:kworker.0 00000100:00100000:2.0:1788263442.314125:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753762432 00000100:00100000:2.0:1788263442.314146:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753762432 00000100:00100000:2.0:1788263442.314256:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263442.314267:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1875129753762432:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788263442.314307:0:14499:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:2.0:1788263442.314366:0:14499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1a657bc513956de4 00000004:00100000:2.0:1788263442.314389:0:14499:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788263442.314441:0:14499:0:(import.c:65:import_set_state_nolock()) ffff9943803ef800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263442.314558:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875129753762432:12345-0@lo:38:llog_process_th.0 Request processed in 291us (4951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263442.314567:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788263442.315848:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9943810d9880 x1875129753762432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263442.315882:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263442.315903:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788263442.315914:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788263442.315928:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788263442.315932:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9943803e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788263442.315942:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753762432:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788263442.317318:0:15911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788263442.318121:0:15900:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788263442.318161:0:15900:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263442.318184:0:15900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.318199:0:15900:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788263442.318305:0:15900:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788263442.318308:0:15900:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788263442.318309:0:15900:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263442.318310:0:15900:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263442.318311:0:15900:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263442.318313:0:15900:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263442.318314:0:15900:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263442.318316:0:15900:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263442.318318:0:15900:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263442.318324:0:15900:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788263442.318333:0:15900:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788263442.318334:0:15900:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788263442.318335:0:15900:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263442.318336:0:15900:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263442.318337:0:15900:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263442.318338:0:15900:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263442.318339:0:15900:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263442.318339:0:15900:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263442.318340:0:15900:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263442.318378:0:15900:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788263442.318407:0:15900:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753763072:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788263442.318510:0:15900:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263442.318556:0:15900:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375fddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263442.320821:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753763072 00000100:00100000:3.0:1788263442.320843:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753763072 00000100:00100000:3.0:1788263442.320949:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788263442.320963:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:15900:x1875129753763072:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788263442.321010:0:14491:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788263442.321032:0:14491:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788263442.443848:0:14491:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788263442.443878:0:14491:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788263442.444060:0:14513:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788263442.444067:0:14513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788263442.444099:0:14513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.444375:0:14513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956cbe expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.444387:0:14513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.444625:0:14513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513956cbe expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.444648:0:14513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513956cbe expref: 19 pid: 14492 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263442.444680:0:14513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14513:1875129753763200:0@lo:104: 00000100:00100000:2.0:1788263442.444790:0:14513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263442.445059:0:14513:0:(client.c:2715:ptlrpc_set_wait()) set ffff994352af4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263442.446058:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753763200 00000100:00100000:3.0:1788263442.446074:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753763200 00000100:00100000:3.0:1788263442.446390:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263442.446405:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+3:14513:x1875129753763200:12345-0@lo:104: 00010000:00010000:3.0:1788263442.446436:0:14480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.446541:0:14480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263442.446549:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+3:14513:x1875129753763200:12345-0@lo:104: Request processed in 148us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.446681:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263442.446778:0:14513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14513:1875129753763200:0@lo:104: 00010000:00010000:1.0:1788263442.446808:0:14513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.447443:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263442.447470:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.447480:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6600 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:3.0:1788263442.447485:0:14486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.447495:0:14486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263442.447502:0:14486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263442.447509:0:14486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263442.447604:0:14486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.447612:0:14486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263442.447649:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.447671:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943810d6600/0x1a657bc513956cbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956cc5 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263442.447694:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263442.447695:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263442.447697:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263442.447707:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263442.447727:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753763328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263442.447795:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263442.448119:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753763328 00000100:00100000:2.0:1788263442.448138:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753763328 00010000:00010000:2.0:1788263442.448170:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956cbe expref: 20 pid: 14492 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263442.448352:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263442.448363:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+20:3320:x1875129753763328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263442.448380:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263442.448386:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956cbe expref: 20 pid: 14492 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448400:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513956cbe expref: 20 pid: 14492 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448419:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99437f6b0e00/0x1a657bc513956cc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513956cbe expref: 20 pid: 14492 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448438:0:14483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448462:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788263442.448481:0:14483:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004414698s 00010000:00010000:2.0:1788263442.448486:0:14483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448495:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448502:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448510:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448516:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263442.448521:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448528:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448544:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.448551:0:14513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263442.448554:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263442.448570:0:14513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263442.448576:0:14513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d7c00/0x1a657bc513956deb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263442.448610:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3320:x1875129753763328:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263442.448617:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263442.450585:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753763328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263442.462589:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+18:15900:x1875129753763072:12345-0@lo:253:mount.lustre.0 Request processed in 141614us (144064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263442.462611:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788263442.462871:0:15900:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:91f17ece-9654-41b2-8823-2d6af9d5176a:15900:1875129753763072:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788263442.462922:0:15900:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788263442.462926:0:15900:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788263442.462928:0:15900:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263442.462929:0:15900:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263442.462931:0:15900:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263442.462932:0:15900:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263442.462934:0:15900:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263442.462936:0:15900:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263442.462938:0:15900:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263442.462939:0:15900:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788263442.462956:0:15900:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788263442.470365:0:15900:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263442.470848:0:15900:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788263442.471169:0:15900:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263442.471707:0:15900:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788263442.471863:0:15900:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788263442.474867:0:15900:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788263442.476022:0:15900:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788263442.590911:0:15900:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788263442.590926:0:15900:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788263442.590981:0:15900:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788263442.591067:0:15900:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788263442.591090:0:15900:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788263442.591137:0:15900:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788263442.770074:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263443.771784:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788263444.027870:0:14494:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788263444.027879:0:14494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99434660c800 from 8 10000000:01000000:3.0:1788263444.027885:0:14494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788263444.027935:0:14494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263444.027949:0:14494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263444.027963:0:14494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263444.028005:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753763456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263444.028077:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263444.028130:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f704540 going to sleep for 11 seconds 00000100:00100000:1.0:1788263444.028186:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753763456 00000100:00100000:1.0:1788263444.028194:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753763456 00000100:00100000:1.0:1788263444.028273:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788263444.028292:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:14494:x1875129753763456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263444.028306:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263444.028328:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99437f6b0600/0x1a657bc513956df9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956df2 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263444.028354:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99437f6b0600/0x1a657bc513956df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956df2 expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263444.028365:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99437f6b0600/0x1a657bc513956df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956df2 expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263444.028374:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99437f6b0600, rc 0) 00000100:00100000:1.0:1788263444.028412:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:14494:x1875129753763456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263444.028419:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788263444.028768:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753763456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263444.028786:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263444.028797:0:14494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263444.028851:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347205500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753763584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788263444.028886:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263444.028913:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff994342beecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263444.029208:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753763584 00000100:00100000:3.0:1788263444.029234:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753763584 00000100:00100000:3.0:1788263444.029265:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788263444.029272:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:14494:x1875129753763584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788263444.029288:0:14490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788263444.029306:0:14490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788263444.029311:0:14490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788263444.029400:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:14494:x1875129753763584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263444.029407:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788263444.029438:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347205500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753763584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788263444.029488:0:14494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788263444.029495:0:14494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263444.029504:0:14494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263444.735968:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263444.736000:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753763712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263444.736089:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263444.736289:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753763712 00000100:00100000:1.0:1788263444.736297:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753763712 00000100:00100000:1.0:1788263444.736357:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263444.736367:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753763712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263444.736400:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263444.736448:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753763712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263444.736455:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788263444.736664:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263444.737139:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753763712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263444.797821:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263445.819545:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263446.850826:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788263447.816453:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263447.816460:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788263447.816464:0:492:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263447.816477:0:492:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99437fb70800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263447.816499:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99437630f800 x1875129753764096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263447.816556:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753764352:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.816712:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.816785:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788263447.816792:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753763840:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.816821:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.816842:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753764480:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.816865:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.816890:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753763968:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.816914:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.816932:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263447.816937:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753764224:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.816955:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.816983:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753764096:0@lo:8:kworker.0 00000100:00100000:3.0:1788263447.817010:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.817041:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753764352 00000100:00100000:3.0:1788263447.817049:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753764352 00000100:00100000:3.0:1788263447.818703:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753764480 00000100:00100000:3.0:1788263447.818714:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753764480 00000100:00100000:3.0:1788263447.818737:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753764224 00000100:00100000:3.0:1788263447.818740:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753764224 00000100:00100000:3.0:1788263447.818758:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263447.818771:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753764352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.818853:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753764352:12345-0@lo:400:kworker.0 Request processed in 84us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.818861:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263447.818877:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263447.818884:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753764480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.818909:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753764480:12345-0@lo:400:kworker.0 Request processed in 26us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.818930:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263447.818942:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263447.818947:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753764224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.818982:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753764224:12345-0@lo:400:kworker.0 Request processed in 35us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.818988:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263447.819011:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753763840 00000100:00100000:3.0:1788263447.819015:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753763840 00000100:00100000:3.0:1788263447.819043:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788263447.819050:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3322:x1875129753763840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.819946:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3322:x1875129753763840:12345-0@lo:400:kworker.0 Request processed in 892us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.819955:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788263447.820002:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753763968 00000100:00100000:3.0:1788263447.820008:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753763968 00000100:00100000:3.0:1788263447.820044:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753764096 00000100:00100000:3.0:1788263447.820047:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753764096 00000100:00100000:3.0:1788263447.820058:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263447.820064:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753763968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.820181:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753763968:12345-0@lo:400:kworker.0 Request processed in 116us (3265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.820187:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263447.820200:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788263447.820204:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3319:x1875129753764096:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788263447.820316:0:15183:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:3.0:1788263447.820345:0:15183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513956e00 00002000:00100000:3.0:1788263447.820373:0:15183:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff994243365800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788263447.820377:0:15183:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788263447.820380:0:15183:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788263447.823348:0:15183:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788263447.823388:0:15183:0:(import.c:65:import_set_state_nolock()) ffff994243364800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263447.823485:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875129753764096:12345-0@lo:8:kworker.0 Request processed in 3277us (6472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.823495:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788263447.823537:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263447.823543:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788263447.823747:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437630f800 x1875129753764096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788263447.823767:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788263447.823777:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788263447.823782:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788263447.823785:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788263447.823804:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788263447.823810:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753764096:0@lo:8:kworker.0 00000004:00080000:1.0:1788263447.823980:0:14522:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788263447.824001:0:14522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14522:1875129753764736:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788263447.824041:0:14522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.825323:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753764608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263447.825381:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788263447.825429:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437630d180 x1875129753764224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263447.825444:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753764224:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.825459:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753763968:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.825502:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753763840:0@lo:400:kworker.0 00010000:00080000:3.0:1788263447.825515:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437630dc00 x1875129753764480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263447.825525:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753764480:0@lo:400:kworker.0 00010000:00080000:3.0:1788263447.825537:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437630ca80 x1875129753764352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263447.825546:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753764352:0@lo:400:kworker.0 00000100:00100000:1.0:1788263447.825699:0:14522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434969b540 going to sleep for 11 seconds 00000004:00080000:1.0:1788263447.825717:0:14521:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788263447.826819:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753764736 00000100:00100000:0.0:1788263447.826830:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753764736 00000004:00080000:1.0:1788263447.827037:0:14521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 474614817880ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788263447.827062:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753764608 00000100:00100000:1.0:1788263447.827066:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753764608 00000100:00100000:1.0:1788263447.827110:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263447.827120:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875129753764608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263447.827153:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263447.827255:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875129753764608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263447.827262:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788263447.827321:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437f509c00 x1875129753764608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263447.827341:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753764608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263447.836987:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263447.837012:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14522:x1875129753764736:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788263447.839303:0:15184:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788263447.839313:0:15184:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788263447.839318:0:15184:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00080000:1.0:1788263447.860805:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788263447.887769:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.887784:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.887802:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.887807:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.887813:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.887837:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.887847:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.887855:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.887875:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788263447.893687:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.893707:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.893731:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.893737:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.893746:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.893762:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.893773:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.893796:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.893809:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788263447.900557:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.900583:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.900602:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.900608:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.900615:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.900632:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.900643:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.900651:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.900663:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788263447.901117:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.901123:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901139:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.901142:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.901146:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901155:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901163:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901170:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901178:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788263447.901626:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.901633:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901642:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.901646:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.901650:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901660:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901679:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901688:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.901696:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788263447.902052:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.902058:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.902067:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.902070:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.902074:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.902083:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.902092:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.902099:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.902119:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788263447.902516:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.902523:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.902532:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.902535:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.902540:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.902549:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906208:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788263447.906249:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906265:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263447.906271:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906283:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906308:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906322:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513956e07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906344:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788263447.906348:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906355:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263447.906359:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906368:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906379:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906387:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc513956e0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906398:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788263447.906402:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906409:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263447.906417:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906426:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906436:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906444:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d095fcac/0x1a657bc513956e15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906456:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788263447.906470:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906478:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263447.906481:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906490:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906500:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906508:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8deca92/0x1a657bc513956e1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906527:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263447.906531:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906537:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263447.906541:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906549:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906570:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906587:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3c649fc/0x1a657bc513956e23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906598:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263447.906602:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906607:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263447.906610:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906629:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906640:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906648:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822fdb49/0x1a657bc513956e2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.906661:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.906663:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.906665:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.910406:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.912203:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.912258:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.912287:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788263447.912938:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.912948:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.912963:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.912974:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.912982:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.912997:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913008:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913016:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913037:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788263447.913469:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.913475:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913484:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.913487:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.913491:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913501:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913509:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913523:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913532:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788263447.913931:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.913937:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913947:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.913950:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.913954:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913963:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913971:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913978:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.913986:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788263447.914403:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.914410:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914424:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.914428:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.914433:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914443:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914452:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914460:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914470:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788263447.914879:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.914885:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914894:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.914897:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.914902:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914912:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914931:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914938:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.914946:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788263447.919312:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788263447.919329:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919342:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263447.919347:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919358:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919385:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919393:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513956e31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919417:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788263447.919422:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919428:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263447.919431:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919453:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919463:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919469:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513956e38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919482:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788263447.919486:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919493:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263447.919496:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919503:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919511:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919518:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc513956e3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919538:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788263447.919542:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919549:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263447.919552:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919578:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919592:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919599:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513956e46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919610:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788263447.919613:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919619:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382042000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263447.919623:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919640:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919649:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919655:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daa8d227/0x1a657bc513956e4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919668:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263447.919671:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919678:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382043400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263447.919681:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919687:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919695:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919702:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ae3a4f2/0x1a657bc513956e54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.919724:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263447.919726:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263447.919728:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.923049:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263447.925828:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.925849:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.925872:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.925878:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.925886:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.925901:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.925914:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.925924:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.925963:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788263447.927153:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.927164:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.927179:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.927183:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.927188:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.927199:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.927209:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.927317:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.927337:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788263447.929972:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.929986:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.930002:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.930015:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.930022:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.930037:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.930049:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.930057:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.932730:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000001:00100000:2.0:1788263447.933973:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788263447.937482:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.937499:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.937519:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.937524:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.937531:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.937546:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937712:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788263447.937734:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937744:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382042200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263447.937749:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937759:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937786:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937793:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5f05565/0x1a657bc513956e5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937823:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263447.937828:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937835:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382043a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263447.937839:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937846:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937867:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937875:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dae6260/0x1a657bc513956e62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937891:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263447.937895:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937901:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382043e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263447.937904:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937912:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937921:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937928:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac2cc3e2/0x1a657bc513956e69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.937940:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263447.937942:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263447.937949:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263447.937957:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.939806:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.939844:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.939876:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263447.940163:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263447.940171:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.940180:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382042c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263447.940185:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.940197:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.940246:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.940262:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003362795c/0x1a657bc513956e70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.940286:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.940288:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.940290:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263447.940952:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788263447.940960:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.940972:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788263447.940977:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263447.940984:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.940995:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.941004:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.941013:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.941035:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263447.941179:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263447.941186:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.941195:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382042400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263447.941199:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.941208:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.941248:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.941257:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b04f29d/0x1a657bc513956e77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.941274:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263447.941276:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263447.941277:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788263447.952061:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788263447.954967:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263447.954980:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.954996:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788263447.955001:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263447.955008:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.955023:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.955033:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.955041:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.957208:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263447.957352:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263447.957378:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.957393:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.957399:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.957412:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.957436:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.957448:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.957450:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.957451:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.957498:0:15184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000372386e1/0x1a657bc513956e7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263447.960054:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263447.960079:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960099:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788263447.960103:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263447.960109:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960123:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960135:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960143:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960171:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788263447.960760:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263447.960769:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960778:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788263447.960781:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263447.960792:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960802:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960811:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960819:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.960836:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788263447.961269:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263447.961276:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.961285:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788263447.961289:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263447.961294:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.961303:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.961312:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.961332:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.961341:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788263447.966703:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788263447.966723:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966740:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.966746:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966757:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966781:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966806:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002154d58f/0x1a657bc513956e85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966834:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263447.966839:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966845:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b0e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.966848:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966855:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966866:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966874:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda00d06/0x1a657bc513956e8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966886:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263447.966890:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966896:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.966904:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966912:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966921:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966928:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000876023bd/0x1a657bc513956e93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.966939:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.966941:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.966942:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.967447:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263447.968006:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263447.968016:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.968030:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788263447.968034:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263447.968041:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.968053:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.968062:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.968877:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.968904:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263447.969155:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263447.969162:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.969171:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.969175:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.969185:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.969201:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.969242:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e1211da/0x1a657bc513956e9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.969263:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.969264:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.969266:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263447.969806:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263447.969814:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.969831:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788263447.969834:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263447.969840:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.969850:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.969858:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.969865:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.969889:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263447.971888:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263447.971903:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.971917:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.971923:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.971935:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.971957:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.971965:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59cbf9a/0x1a657bc513956ea1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.971987:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.971989:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.971991:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263447.972996:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263447.973009:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.973023:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788263447.973028:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263447.973033:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.973045:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.973065:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.980351:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.980403:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788263447.981056:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263447.981065:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.981676:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263447.981686:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.981697:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.981702:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.981713:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.981735:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.981742:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a64006/0x1a657bc513956ea8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.981766:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.981768:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.981770:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.982427:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788263447.982432:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263447.982440:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.982454:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.982464:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.982472:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.982504:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263447.982516:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263447.982521:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.982528:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263447.982532:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.982540:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.982552:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.985607:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d81637a8/0x1a657bc513956eaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.985636:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.985638:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263447.985641:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263447.987924:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263447.987938:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.987959:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788263447.987963:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263447.987970:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.987983:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.987993:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.988001:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.988028:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263447.988737:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263447.988747:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.988758:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.988763:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.988790:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.988809:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.988817:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bd7e548/0x1a657bc513956eb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.988838:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.988839:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.988841:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263447.991893:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263447.991906:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.991923:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788263447.991928:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263447.991934:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.991948:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.991971:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.991980:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.992002:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263447.992180:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263447.992188:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.992197:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.992202:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.992211:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.993432:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.993459:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000272dbf2f/0x1a657bc513956ebd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.993480:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.993482:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.993484:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263447.995671:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263447.995682:0:15184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.995699:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=474s v=(0 0) 00010000:00010000:2.0:1788263447.995703:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263447.995709:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.995723:0:15184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.995734:0:15184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.995743:0:15184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.995778:0:15184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788263447.995969:0:15184:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788263447.996074:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14522:x1875129753764736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 159068us (172028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263447.996084:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263447.996142:0:14522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f509f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14522:1875129753764736:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788263447.996157:0:14522:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788263447.996205:0:14522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810da680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14522:1875129753764864:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788263447.996285:0:14522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263447.996322:0:14522:0:(client.c:2715:ptlrpc_set_wait()) set ffff994380c86840 going to sleep for 11 seconds 00000100:00100000:2.0:1788263447.996350:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753764864 00000100:00100000:2.0:1788263447.996356:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753764864 00000100:00100000:2.0:1788263447.996391:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263447.996400:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14522:x1875129753764864:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788263447.996433:0:15184:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788263447.997597:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263447.997609:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.997622:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263447.997626:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.997637:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.997657:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.997664:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b94cc460/0x1a657bc513956ec4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.997683:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.997685:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263447.997686:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263448.020200:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14522:x1875129753764864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23791us (23905us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788263448.020253:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263448.021912:0:14522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810da680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14522:1875129753764864:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788263448.021933:0:14522:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788263448.894103:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263449.853926:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263449.853956:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753764992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263449.854040:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263449.854155:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753764992 00000100:00100000:0.0:1788263449.854163:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753764992 00000100:00100000:0.0:1788263449.854261:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263449.854272:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753764992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263449.854311:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263449.854367:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753764992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263449.854374:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263449.854427:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347205500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753764992:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788263449.854489:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788263449.916137:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788263450.578264:0:16259:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788263450.943988:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263451.390933:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788263451.964156:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263452.923558:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753765248:0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.923628:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263452.923684:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753765760:0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.923713:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263452.923747:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788263452.923754:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753765120:0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.923780:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263452.923801:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753765632:0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.923821:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263452.923994:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753765376:0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.924017:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263452.924032:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263452.924037:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753765504:0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.924053:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263452.924276:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753765248 00000100:00100000:3.0:1788263452.924285:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753765248 00000100:00100000:3.0:1788263452.924336:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753765376 00000100:00100000:3.0:1788263452.924339:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753765376 00000100:00100000:3.0:1788263452.924357:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263452.924368:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753765248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263452.924494:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753765248:12345-0@lo:400:kworker.0 Request processed in 128us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.924501:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263452.924518:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263452.924525:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875129753765376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263452.924556:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875129753765376:12345-0@lo:400:kworker.0 Request processed in 32us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.924561:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263452.924579:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753765760 00000100:00100000:3.0:1788263452.924583:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753765760 00000100:00100000:3.0:1788263452.924601:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753765632 00000100:00100000:3.0:1788263452.924611:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753765632 00000100:00100000:3.0:1788263452.924625:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753765504 00000100:00100000:3.0:1788263452.924628:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753765504 00000100:00100000:3.0:1788263452.924639:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788263452.924645:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753765760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263452.924676:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753765760:12345-0@lo:400:kworker.0 Request processed in 31us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.924682:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788263452.924693:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788263452.924699:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753765632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263452.924723:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753765632:12345-0@lo:400:kworker.0 Request processed in 25us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.924728:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788263452.924739:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788263452.924744:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753765504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263452.924769:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753765504:12345-0@lo:400:kworker.0 Request processed in 24us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.924773:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788263452.924798:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263452.924805:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263452.924807:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788263452.924832:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943810da300 x1875129753765504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263452.924848:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753765504:0@lo:400:kworker.0 00000100:00100000:3.0:1788263452.924862:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753765376:0@lo:400:kworker.0 00000100:00100000:1.0:1788263452.925035:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753765120 00000100:00100000:1.0:1788263452.925039:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753765120 00000100:00100000:1.0:1788263452.925069:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788263452.925076:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753765120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263452.925115:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753765120:12345-0@lo:400:kworker.0 Request processed in 39us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263452.925121:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788263452.925192:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753765120:0@lo:400:kworker.0 00010000:00080000:3.0:1788263452.925210:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943810d9500 x1875129753765632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263452.925245:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753765632:0@lo:400:kworker.0 00000100:00100000:3.0:1788263452.925258:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753765248:0@lo:400:kworker.0 00010000:00080000:3.0:1788263452.925268:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9943810d9f80 x1875129753765760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263452.925277:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753765760:0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.925526:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263452.925537:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753765888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263452.925569:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263452.926487:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753765888 00000100:00100000:3.0:1788263452.926496:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753765888 00000100:00100000:3.0:1788263452.926531:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788263452.926539:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753765888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263452.926566:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263452.926627:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753765888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.926634:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263452.928189:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437630dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753765888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788263452.987854:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788263453.001919:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1788263453.260178:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263453.260712:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735945728 00000100:00100000:3.0:1788263453.260723:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735945728 00000100:00100000:3.0:1788263453.260780:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:3.0:1788263453.260791:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875129735945728:12345-192.168.201.29@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788263453.260828:0:14492:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5b43f238-23cd-4921-93f7-57aed6f2c2c6@192.168.201.29@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1788263453.260865:0:14492:0:(genops.c:1385:class_connect()) connect: client 5b43f238-23cd-4921-93f7-57aed6f2c2c6, cookie 0x1a657bc513956ecb 00000100:00080000:3.0:1788263453.261024:0:14492:0:(import.c:65:import_set_state_nolock()) ffff994243367000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263453.261101:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+5:2358:x1875129735945728:12345-192.168.201.29@tcp:250:mount.lustre.0 Request processed in 311us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263453.261124:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:2.0:1788263453.272602:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263453.272704:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735945856 00000100:00100000:1.0:1788263453.272716:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735945856 00000100:00100000:1.0:1788263453.272782:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:1.0:1788263453.272794:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+5:13757:x1875129735945856:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788263453.272812:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263453.272831:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242899200/0x1a657bc513956ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33e6 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263453.272861:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242899200/0x1a657bc513956ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33e6 expref: 6 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263453.272871:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242899200/0x1a657bc513956ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33e6 expref: 6 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263453.272880:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899200, rc 0) 00000100:00100000:1.0:1788263453.272957:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+6:13757:x1875129735945856:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 165us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263453.272965:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:0.0:1788263453.295015:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263453.295380:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735945984 00000100:00100000:1.0:1788263453.295390:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735945984 00000100:00100000:1.0:1788263453.295449:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:1.0:1788263453.295460:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+6:13757:x1875129735945984:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788263453.295873:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+6:13757:x1875129735945984:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 414us (871us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263453.295882:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:2.0:1788263453.305509:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263453.306006:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735946112 00000100:00100000:3.0:1788263453.306019:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735946112 00000100:00100000:3.0:1788263453.306091:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:3.0:1788263453.306103:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+6:13757:x1875129735946112:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788263453.306127:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263453.306152:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216c600/0x1a657bc513956ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d33ed expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.306190:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216c600/0x1a657bc513956ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ed expref: 7 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.306202:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216c600/0x1a657bc513956ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ed expref: 7 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.306360:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216c600, rc 0) 00000100:00100000:3.0:1788263453.306414:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+7:13757:x1875129735946112:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 312us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263453.306422:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:2.0:1788263453.315905:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263453.316157:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735946240 00000100:00100000:1.0:1788263453.316169:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735946240 00000100:00100000:1.0:1788263453.316284:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:1.0:1788263453.316296:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+7:13757:x1875129735946240:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788263453.316615:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+8:13757:x1875129735946240:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 319us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263453.316623:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1788263453.328606:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263453.328715:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735946368 00000100:00100000:1.0:1788263453.328725:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735946368 00000100:00100000:1.0:1788263453.328786:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:1.0:1788263453.328797:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+8:13757:x1875129735946368:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788263453.329029:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+8:13757:x1875129735946368:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 233us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263453.329037:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:2.0:1788263453.360929:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263453.361026:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735946496 00000100:00100000:3.0:1788263453.361036:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735946496 00000100:00100000:3.0:1788263453.361096:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1788263453.361107:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+8:13776:x1875129735946496:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263453.361431:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+8:13776:x1875129735946496:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 324us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263453.361440:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:0.0:1788263453.379824:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263453.379979:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735946624 00000100:00100000:2.0:1788263453.379989:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735946624 00000100:00100000:2.0:1788263453.380047:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:2.0:1788263453.380057:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+8:13776:x1875129735946624:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263453.380632:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+8:13776:x1875129735946624:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 572us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263453.380641:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:0.0:1788263453.390350:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263453.390816:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735946752 00000100:00100000:1.0:1788263453.390827:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735946752 00000100:00100000:1.0:1788263453.390886:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:1.0:1788263453.390898:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+8:13757:x1875129735946752:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788263453.390915:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263453.390933:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242899400/0x1a657bc513956ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3417 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263453.390992:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242899400/0x1a657bc513956ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3417 expref: 9 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263453.391004:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242899400/0x1a657bc513956ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3417 expref: 9 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263453.391015:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899400, rc 0) 00000100:00100000:1.0:1788263453.391079:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+9:13757:x1875129735946752:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 184us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263453.391085:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:0.0:1788263453.408302:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263453.409567:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735946880 00000100:00100000:2.0:1788263453.409580:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735946880 00000100:00100000:2.0:1788263453.409649:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:2.0:1788263453.409661:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+9:13757:x1875129735946880:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788263453.409687:0:14491:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788263453.409710:0:14491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788263453.409714:0:14491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788263453.409718:0:14491:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788263453.409720:0:14491:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788263453.419891:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+9:13757:x1875129735946880:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 10220us (11587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263453.419916:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:0.0:1788263453.431411:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263453.431510:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735947008 00000100:00100000:3.0:1788263453.431520:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735947008 00000100:00100000:3.0:1788263453.431581:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1788263453.431591:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+9:13757:x1875129735947008:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788263453.431608:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263453.431625:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d341e expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.431651:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d341e expref: 10 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.431662:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d341e expref: 10 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.431671:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216cc00, rc 0) 00000100:00100000:3.0:1788263453.431729:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13757:x1875129735947008:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 139us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263453.431736:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:0.0:1788263453.433779:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263453.433925:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735947136 00000100:00100000:2.0:1788263453.433933:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735947136 00000100:00100000:2.0:1788263453.433986:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:2.0:1788263453.433998:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13757:x1875129735947136:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788263453.434357:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13757:x1875129735947136:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 360us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263453.434381:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:0.0:1788263453.436527:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263453.436619:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735947264 00000100:00100000:1.0:1788263453.436628:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735947264 00000100:00100000:1.0:1788263453.436678:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:1.0:1788263453.436687:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13757:x1875129735947264:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788263453.436922:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13757:x1875129735947264:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 235us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263453.436931:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:0.0:1788263453.442650:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263453.442756:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735947392 00000100:00100000:3.0:1788263453.442778:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735947392 00000100:00100000:3.0:1788263453.442840:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:3.0:1788263453.442850:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13781:x1875129735947392:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263453.443126:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13781:x1875129735947392:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 277us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263453.443639:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:0.0:1788263453.446033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263453.446149:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735947520 00000100:00100000:2.0:1788263453.446159:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735947520 00000100:00100000:2.0:1788263453.446242:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:2.0:1788263453.446253:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13781:x1875129735947520:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263453.446517:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13781:x1875129735947520:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 264us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263453.446525:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:0.0:1788263453.450455:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263453.450566:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735947648 00000100:00100000:3.0:1788263453.450575:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735947648 00000100:00100000:3.0:1788263453.450641:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788263453.450650:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1875129735947648:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788263453.450683:0:14497:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from aaa94f48-2848-4430-a76d-a41ea14a2177@192.168.201.29@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1788263453.450734:0:14497:0:(genops.c:1385:class_connect()) connect: client aaa94f48-2848-4430-a76d-a41ea14a2177, cookie 0x1a657bc513956eee 00000004:00100000:3.0:1788263453.450764:0:14497:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788263453.450769:0:14497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788263453.534578:0:14497:0:(import.c:65:import_set_state_nolock()) ffff994241ada000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263453.534671:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+6:2358:x1875129735947648:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 84018us (84224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263453.534683:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1788263453.537967:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263453.538013:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263453.538293:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735947904 00000100:00100000:3.0:1788263453.538303:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735947904 00000100:00100000:3.0:1788263453.538363:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735947776 00000100:00100000:3.0:1788263453.538366:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735947776 00000100:00100000:3.0:1788263453.538384:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263453.538393:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+7:13757:x1875129735947904:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788263453.538430:0:14498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788263453.538515:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+7:13757:x1875129735947904:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 121us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263453.538522:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263453.538541:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788263453.538547:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+6:0:x1875129735947776:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788263453.538557:0:14498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788263453.538573:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+6:0:x1875129735947776:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 27us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263453.538579:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:2.0:1788263453.538715:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263453.542410:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263453.542854:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735948032 00000100:00100000:3.0:1788263453.542865:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735948032 00000100:00100000:3.0:1788263453.542925:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788263453.542936:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+6:13757:x1875129735948032:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788263453.543205:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+6:13757:x1875129735948032:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 270us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263453.543256:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788263453.557560:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263453.557697:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735948160 00000100:00100000:0.0:1788263453.557708:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735948160 00000100:00100000:0.0:1788263453.557757:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263453.557785:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875129735948160:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788263453.557818:0:15182:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aaa94f48-2848-4430-a76d-a41ea14a2177@192.168.201.29@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:0.0:1788263453.557851:0:15182:0:(genops.c:1385:class_connect()) connect: client aaa94f48-2848-4430-a76d-a41ea14a2177, cookie 0x1a657bc513956ef5 00002000:00100000:0.0:1788263453.557865:0:15182:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aaa94f48-2848-4430-a76d-a41ea14a2177/ffff9942435ee000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788263453.557889:0:15182:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788263453.558288:0:15182:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788263453.558322:0:15182:0:(import.c:65:import_set_state_nolock()) ffff9942435e8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263453.558404:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+6:2358:x1875129735948160:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 618us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263453.558413:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263453.559106:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263453.559998:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263453.560634:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735948288 00000100:00100000:2.0:1788263453.560647:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735948288 00000100:00100000:2.0:1788263453.560703:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263453.560713:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875129735948288:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788263453.560749:0:15184:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aaa94f48-2848-4430-a76d-a41ea14a2177@192.168.201.29@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:2.0:1788263453.560782:0:15184:0:(genops.c:1385:class_connect()) connect: client aaa94f48-2848-4430-a76d-a41ea14a2177, cookie 0x1a657bc513956efc 00002000:00100000:2.0:1788263453.560793:0:15184:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aaa94f48-2848-4430-a76d-a41ea14a2177/ffff9943803ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788263453.560804:0:15184:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788263453.560937:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735948416 00000100:00100000:0.0:1788263453.560942:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735948416 00000100:00100000:0.0:1788263453.561041:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788263453.561049:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+6:13757:x1875129735948416:12345-192.168.201.29@tcp:33:mount.lustre.0 00002000:00080000:2.0:1788263453.561645:0:15184:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788263453.561678:0:15184:0:(import.c:65:import_set_state_nolock()) ffff9943803ec800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263453.561755:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+6:2358:x1875129735948288:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 1041us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263453.561764:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000004:00080000:0.0:1788263453.564889:0:14500:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3779us 00000004:00200000:2.0:1788263453.599616:0:14500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788263453.599757:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+6:13757:x1875129735948416:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 38699us (39752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263453.599780:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263453.762420:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263453.762583:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735948544 00000100:00100000:0.0:1788263453.762594:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735948544 00000100:00100000:0.0:1788263453.762664:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1788263453.762678:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+6:13802:x1875129735948544:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:0.0:1788263453.762702:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263453.762777:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc513956f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3448 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.762856:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc513956f0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.762883:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc513956f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.762898:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc513956f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263453.762935:0:14497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788263453.762940:0:14497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263453.762978:0:14497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc513956f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.763007:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382042200/0x1a657bc513956f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3448 expref: 8 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.763027:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc513956f0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3448 expref: 7 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.763036:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9942419f8100) 00010000:00010000:0.0:1788263453.763039:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263453.763043:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382043a00, rc 0) 00000100:00100000:0.0:1788263453.763109:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+7:13802:x1875129735948544:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 433us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263453.763116:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:3.0:1788263454.014671:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263454.971536:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263454.971563:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753766016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263454.971642:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263454.971776:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753766016 00000100:00100000:3.0:1788263454.971785:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753766016 00000100:00100000:3.0:1788263454.971860:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788263454.971870:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753766016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263454.971892:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263454.971961:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753766016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263454.971969:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263454.972064:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753766016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788263454.972233:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788263455.035509:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788263455.546813:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aaa94f48-2848-4430-a76d-a41ea14a2177 00000100:00100000:3.0:1788263455.938812:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263455.938936:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735948672 00000100:00100000:0.0:1788263455.938947:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735948672 00000100:00100000:0.0:1788263455.939314:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263455.939339:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+7:13854:x1875129735948672:12345-192.168.201.29@tcp:41:lfs.0 00000004:00000024:0.0:1788263455.939384:0:14498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788263455.939495:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+7:13854:x1875129735948672:12345-192.168.201.29@tcp:41:lfs.0 Request processed in 158us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263455.939503:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00080000:2.0:1788263455.943583:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263455.944742:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263455.944880:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735948800 00000100:00100000:3.0:1788263455.944891:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735948800 00000100:00100000:3.0:1788263455.944966:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788263455.944990:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aaa94f48-2848-4430-a76d-a41ea14a2177+5:13854:x1875129735948800:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:3.0:1788263455.945029:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263455.945130:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aaa94f48-2848-4430-a76d-a41ea14a2177+5:13854:x1875129735948800:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 143us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263455.945139:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00080000:2.0:1788263455.945696:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263455.947922:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263455.948112:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735948928 00000100:00100000:0.0:1788263455.948121:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735948928 00000100:00100000:0.0:1788263455.948277:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1788263455.948290:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aaa94f48-2848-4430-a76d-a41ea14a2177+6:13854:x1875129735948928:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:0.0:1788263455.948336:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263455.948430:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aaa94f48-2848-4430-a76d-a41ea14a2177+6:13854:x1875129735948928:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 134us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263455.948439:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00080000:2.0:1788263455.957482:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788263456.059387:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263456.121399:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263456.121528:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735949056 00000100:00100000:1.0:1788263456.121538:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735949056 00000100:00100000:1.0:1788263456.121599:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:1.0:1788263456.121611:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:13886:x1875129735949056:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788263456.121629:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263456.121657:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242899e00/0x1a657bc513956f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d344f expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263456.121685:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242899e00/0x1a657bc513956f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d344f expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263456.121697:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242899e00/0x1a657bc513956f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d344f expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263456.121706:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899e00, rc 0) 00000100:00100000:1.0:1788263456.121764:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13886:x1875129735949056:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 156us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263456.121772:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:3.0:1788263456.131468:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263456.131607:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735949184 00000100:00100000:0.0:1788263456.131619:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735949184 00000100:00100000:0.0:1788263456.131683:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:0.0:1788263456.131694:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13886:x1875129735949184:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788263456.132055:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f71fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13886:x1875129735949184:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 361us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263456.132064:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:3.0:1788263456.136302:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263456.136440:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735949312 00000100:00100000:2.0:1788263456.136452:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735949312 00000100:00100000:2.0:1788263456.136502:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:2.0:1788263456.136512:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13886:x1875129735949312:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788263456.137291:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13886:x1875129735949312:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 775us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263456.137309:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:3.0:1788263456.155677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263456.164518:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735949440 00000100:00100000:1.0:1788263456.164534:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735949440 00000100:00100000:1.0:1788263456.164606:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:1.0:1788263456.164617:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13893:x1875129735949440:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263456.165005:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13893:x1875129735949440:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 389us (9336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263456.165013:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:3.0:1788263456.198870:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263456.199073:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735949568 00000100:00100000:2.0:1788263456.199085:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735949568 00000100:00100000:2.0:1788263456.199141:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:2.0:1788263456.199151:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13893:x1875129735949568:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263456.199463:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13893:x1875129735949568:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 312us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263456.199472:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:1.0:1788263456.204539:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263456.204656:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735949696 00000100:00100000:3.0:1788263456.204667:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735949696 00000100:00100000:3.0:1788263456.204726:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:3.0:1788263456.204737:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13886:x1875129735949696:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788263456.204753:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263456.204769:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d400/0x1a657bc513956f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3479 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263456.204797:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d400/0x1a657bc513956f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3479 expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263456.204808:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d400/0x1a657bc513956f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3479 expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263456.204819:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d400, rc 0) 00000100:00100000:3.0:1788263456.204889:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13886:x1875129735949696:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 153us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263456.204906:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:3.0:1788263456.214550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263456.215299:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735949824 00000100:00100000:1.0:1788263456.215336:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735949824 00000100:00100000:1.0:1788263456.215394:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:1.0:1788263456.215406:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13886:x1875129735949824:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788263456.215441:0:14490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788263456.215461:0:14490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788263456.215465:0:14490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788263456.215468:0:14490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788263456.215470:0:14490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788263456.219366:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13886:x1875129735949824:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 3950us (4813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263456.219381:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:2.0:1788263456.232182:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263456.232748:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735949952 00000100:00100000:3.0:1788263456.232761:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735949952 00000100:00100000:3.0:1788263456.232818:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:3.0:1788263456.232828:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13886:x1875129735949952:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788263456.232844:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263456.232879:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3480 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263456.232906:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3480 expref: 13 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263456.232918:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3480 expref: 13 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263456.232927:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216c200, rc 0) 00000100:00100000:3.0:1788263456.232983:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13886:x1875129735949952:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 155us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263456.232996:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:3.0:1788263456.241798:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263456.243002:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735950080 00000100:00100000:1.0:1788263456.243016:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735950080 00000100:00100000:1.0:1788263456.243081:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:1.0:1788263456.243091:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13886:x1875129735950080:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788263456.243465:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13886:x1875129735950080:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 375us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263456.243474:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:0.0:1788263456.255869:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263456.255979:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735950208 00000100:00100000:2.0:1788263456.255989:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735950208 00000100:00100000:2.0:1788263456.256056:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:2.0:1788263456.256066:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13886:x1875129735950208:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788263456.256407:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13886:x1875129735950208:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 341us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263456.256426:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:2.0:1788263456.265485:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263456.266407:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735950336 00000100:00100000:3.0:1788263456.266429:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735950336 00000100:00100000:3.0:1788263456.266494:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:3.0:1788263456.266504:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13897:x1875129735950336:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263456.266794:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13897:x1875129735950336:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 290us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263456.266803:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:2.0:1788263456.273064:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263456.273180:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735950464 00000100:00100000:1.0:1788263456.273191:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735950464 00000100:00100000:1.0:1788263456.273289:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:1.0:1788263456.273303:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13897:x1875129735950464:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263456.273602:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13897:x1875129735950464:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 302us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263456.273612:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:0.0:1788263456.287337:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263456.287383:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263456.287439:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263456.287464:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263456.287493:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735950592 00000100:00100000:0.0:1788263456.287502:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735950592 00000100:00100000:0.0:1788263456.287539:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735950976 00000100:00100000:0.0:1788263456.287543:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735950976 00000100:00100000:0.0:1788263456.287569:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788263456.287578:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+7:2359:x1875129735950976:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263456.287669:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+7:2359:x1875129735950976:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263456.287676:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788263456.287696:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:0.0:1788263456.287700:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875129735950592:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788263456.287722:0:14498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 03b4c7a6-bb3d-4ac1-a18b-dbce72656187@192.168.201.29@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:0.0:1788263456.287759:0:14498:0:(genops.c:1385:class_connect()) connect: client 03b4c7a6-bb3d-4ac1-a18b-dbce72656187, cookie 0x1a657bc513956f26 00000004:00100000:0.0:1788263456.287791:0:14498:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788263456.287909:0:14498:0:(import.c:65:import_set_state_nolock()) ffff9942435eb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263456.287938:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2358:x1875129735950592:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 236us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263456.287945:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263456.290018:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735951104 00000100:00100000:3.0:1788263456.290031:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735951104 00000100:00100000:3.0:1788263456.290094:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735951232 00000100:00100000:3.0:1788263456.290099:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735951232 00000100:00100000:3.0:1788263456.290120:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263456.290129:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2359:x1875129735951104:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263456.290204:0:15184:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788263456.290213:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2359:x1875129735951104:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 84us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263456.290214:0:15184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788263456.290260:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1788263456.290276:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788263456.290478:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+6:2359:x1875129735951232:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263456.290511:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+6:2359:x1875129735951232:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 228us (3046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263456.304400:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788263456.310007:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263456.310052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263456.310147:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735950848 00000100:00100000:1.0:1788263456.310173:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735950848 00000100:00100000:1.0:1788263456.310270:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735950720 00000100:00100000:1.0:1788263456.310273:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735950720 00000100:00100000:1.0:1788263456.310296:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:1.0:1788263456.310306:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+7:13886:x1875129735950848:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788263456.310349:0:14497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788263456.310423:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+7:13886:x1875129735950848:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 107us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263456.310431:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:1.0:1788263456.310453:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788263456.310460:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:0:x1875129735950720:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788263456.310470:0:14497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788263456.310490:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:0:x1875129735950720:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263456.310495:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00080000:0.0:1788263456.311151:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263456.317655:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263456.320972:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735951360 00000100:00100000:0.0:1788263456.320999:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735951360 00000100:00100000:0.0:1788263456.321079:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788263456.321088:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:13886:x1875129735951360:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788263456.321208:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:13886:x1875129735951360:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 120us (3574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263456.321247:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788263456.345052:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263456.345089:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263456.345114:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263456.345261:0:16378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735951488 00000100:00100000:2.0:1788263456.345270:0:16378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735951488 00000100:00100000:2.0:1788263456.345307:0:16378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735951616 00000100:00100000:2.0:1788263456.345310:0:16378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735951616 00000100:00100000:2.0:1788263456.345331:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788263456.345340:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875129735951488:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788263456.345372:0:16378:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 03b4c7a6-bb3d-4ac1-a18b-dbce72656187@192.168.201.29@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:2.0:1788263456.345405:0:16378:0:(genops.c:1385:class_connect()) connect: client 03b4c7a6-bb3d-4ac1-a18b-dbce72656187, cookie 0x1a657bc513956f2d 00002000:00100000:2.0:1788263456.345424:0:16378:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03b4c7a6-bb3d-4ac1-a18b-dbce72656187/ffff9943803ee800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788263456.345435:0:16378:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788263456.345672:0:16378:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788263456.345702:0:16378:0:(import.c:65:import_set_state_nolock()) ffff9943803e8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263456.345774:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2358:x1875129735951488:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 433us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263456.345782:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788263456.345800:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788263456.345804:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875129735951616:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788263456.345820:0:16378:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 03b4c7a6-bb3d-4ac1-a18b-dbce72656187@192.168.201.29@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:2.0:1788263456.345835:0:16378:0:(genops.c:1385:class_connect()) connect: client 03b4c7a6-bb3d-4ac1-a18b-dbce72656187, cookie 0x1a657bc513956f34 00002000:00100000:2.0:1788263456.345841:0:16378:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 03b4c7a6-bb3d-4ac1-a18b-dbce72656187/ffff9943803e2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788263456.345846:0:16378:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788263456.345894:0:16378:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788263456.345907:0:16378:0:(import.c:65:import_set_state_nolock()) ffff9943803e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263456.345928:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2358:x1875129735951616:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 122us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263456.345949:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788263456.346268:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735951744 00000100:00100000:1.0:1788263456.346274:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735951744 00000100:00100000:1.0:1788263456.346311:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:1.0:1788263456.346319:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:13886:x1875129735951744:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788263456.346387:0:14501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788263456.346446:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:13886:x1875129735951744:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 128us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263456.346453:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1788263456.588098:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263456.588490:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735951872 00000100:00100000:2.0:1788263456.588501:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735951872 00000100:00100000:2.0:1788263456.588566:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1788263456.588576:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:13919:x1875129735951872:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:2.0:1788263456.588595:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263456.588618:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34aa expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263456.588681:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263456.588695:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263456.588710:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263456.588756:0:14499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263456.588760:0:14499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263456.588780:0:14499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263456.588805:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34aa expref: 8 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263456.588823:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34aa expref: 7 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263456.588846:0:14499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9942419f8100) 00010000:00010000:2.0:1788263456.588849:0:14499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263456.588853:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6600, rc 0) 00000100:00100000:2.0:1788263456.588939:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+7:13919:x1875129735951872:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 364us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263456.588946:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00010000:00010000:2.0:1788263457.083618:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263458.043899:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753766272:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.043994:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263458.044066:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753766784:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044091:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263458.044117:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788263458.044122:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753766144:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044152:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263458.044174:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753766656:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044194:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263458.044253:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753766400:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044280:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263458.044321:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263458.044327:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753766528:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044350:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263458.044400:0:16378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753766272 00000100:00100000:2.0:1788263458.044410:0:16378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753766272 00000100:00100000:2.0:1788263458.044478:0:16378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753766400 00000100:00100000:2.0:1788263458.044493:0:16378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753766400 00000100:00100000:2.0:1788263458.044523:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263458.044533:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753766272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044592:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753766272:12345-0@lo:400:kworker.0 Request processed in 59us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263458.044599:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263458.044617:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263458.044622:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753766400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044647:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753766400:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263458.044652:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263458.044672:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753766784 00000100:00100000:2.0:1788263458.044676:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753766784 00000100:00100000:2.0:1788263458.044694:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753766656 00000100:00100000:2.0:1788263458.044696:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753766656 00000100:00100000:2.0:1788263458.044706:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753766528 00000100:00100000:2.0:1788263458.044708:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753766528 00000100:00100000:2.0:1788263458.044718:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788263458.044723:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753766784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044749:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753766784:12345-0@lo:400:kworker.0 Request processed in 25us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263458.044755:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788263458.044766:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263458.044773:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753766656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044799:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753766656:12345-0@lo:400:kworker.0 Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263458.044805:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263458.044823:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263458.044830:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753766528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044858:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753766528:12345-0@lo:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263458.044865:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263458.044889:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753766144 00000100:00100000:2.0:1788263458.044893:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753766144 00000100:00100000:2.0:1788263458.044923:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788263458.044929:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753766144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.044955:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753766144:12345-0@lo:400:kworker.0 Request processed in 27us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263458.044959:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788263458.044998:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263458.045004:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263458.045006:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263458.045053:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753766528:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.045062:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788263458.045079:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753766400:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.045106:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753766144:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.045117:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753766656:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.045127:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753766272:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.045137:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753766784:0@lo:400:kworker.0 00000100:00100000:2.0:1788263458.046555:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263458.046578:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753766912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263458.046656:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263458.046868:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753766912 00000100:00100000:1.0:1788263458.046879:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753766912 00000100:00100000:1.0:1788263458.046945:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263458.046953:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753766912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263458.046999:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263458.047061:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753766912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263458.047067:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263458.047111:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753766912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788263458.112127:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788263458.180591:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03b4c7a6-bb3d-4ac1-a18b-dbce72656187 00000001:00100000:2.0:1788263458.180612:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aaa94f48-2848-4430-a76d-a41ea14a2177 00000001:00100000:1.0:1788263458.610200:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03b4c7a6-bb3d-4ac1-a18b-dbce72656187 00000001:00100000:1.0:1788263458.610256:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aaa94f48-2848-4430-a76d-a41ea14a2177 00010000:00010000:2.0:1788263459.133419:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263460.096358:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263460.096381:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753767040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263460.096448:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263460.096511:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753767040 00000100:00100000:2.0:1788263460.096519:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753767040 00000100:00100000:2.0:1788263460.096571:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263460.096580:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753767040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263460.096616:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263460.096660:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753767040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263460.096667:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788263460.096687:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263460.096734:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753767040:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788263460.140516:0:16466:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788263460.155360:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788263460.702168:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03b4c7a6-bb3d-4ac1-a18b-dbce72656187 00010000:00010000:3.0:1788263461.180501:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263461.608059:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263461.608150:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263461.608187:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263461.608209:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263461.608243:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263461.608261:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263461.608298:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263461.608342:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735952512 00000100:00100000:2.0:1788263461.608352:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735952512 00000100:00100000:2.0:1788263461.608407:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735952128 00000100:00100000:2.0:1788263461.608419:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735952128 00000100:00100000:2.0:1788263461.608444:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:2.0:1788263461.608454:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2361:x1875129735952512:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263461.608523:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2361:x1875129735952512:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 70us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263461.608531:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:2.0:1788263461.608548:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788263461.608554:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+6:2361:x1875129735952128:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263461.608578:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+6:2361:x1875129735952128:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263461.608597:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788263461.608617:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735952256 00000100:00100000:2.0:1788263461.608620:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735952256 00000100:00100000:2.0:1788263461.608639:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735952768 00000100:00100000:2.0:1788263461.608641:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735952768 00000100:00100000:2.0:1788263461.608653:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735952384 00000100:00100000:2.0:1788263461.608655:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735952384 00000100:00100000:2.0:1788263461.608667:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735952640 00000100:00100000:2.0:1788263461.608669:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735952640 00000100:00100000:2.0:1788263461.608682:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788263461.608688:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2361:x1875129735952256:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263461.608713:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2361:x1875129735952256:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263461.608719:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788263461.608730:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263461.608736:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2361:x1875129735952768:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263461.608771:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2361:x1875129735952768:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263461.608778:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263461.608790:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788263461.608797:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2361:x1875129735952384:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263461.608820:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2361:x1875129735952384:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263461.608827:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788263461.610735:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788263461.610752:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2361:x1875129735952640:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263461.610817:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2361:x1875129735952640:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 71us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263461.610826:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00080000:2.0:1788263461.611237:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263461.611244:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263461.611247:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263461.613397:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735952000 00000100:00100000:3.0:1788263461.613411:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735952000 00000100:00100000:3.0:1788263461.613508:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:3.0:1788263461.613519:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2361:x1875129735952000:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263461.613602:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2361:x1875129735952000:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 85us (5662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263461.613609:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 104 00000040:00080000:1.0:1788263461.627926:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788263462.204733:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263463.165422:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753767168:0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.165497:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263463.165546:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753767680:0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.165590:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263463.165616:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788263463.165622:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753767296:0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.165647:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263463.165666:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753767808:0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.165686:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263463.165715:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753767424:0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.165738:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263463.165755:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263463.165761:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753767552:0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.165797:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263463.165828:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753767168 00000100:00100000:2.0:1788263463.165836:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753767168 00000100:00100000:2.0:1788263463.165878:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788263463.165886:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3322:x1875129753767168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.165938:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3322:x1875129753767168:12345-0@lo:400:kworker.0 Request processed in 51us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.165945:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788263463.165979:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753767680 00000100:00100000:2.0:1788263463.165983:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753767680 00000100:00100000:2.0:1788263463.166011:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753767808 00000100:00100000:2.0:1788263463.166015:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753767808 00000100:00100000:2.0:1788263463.166026:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753767552 00000100:00100000:2.0:1788263463.166028:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753767552 00000100:00100000:2.0:1788263463.166040:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788263463.166045:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753767680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.166077:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753767680:12345-0@lo:400:kworker.0 Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.166083:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788263463.166095:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788263463.166101:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753767808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.166128:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753767808:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.166134:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788263463.166146:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263463.166153:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753767552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.166182:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753767552:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.166196:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263463.167339:0:16378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753767296 00000100:00100000:2.0:1788263463.167349:0:16378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753767296 00000100:00100000:2.0:1788263463.167400:0:16378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753767424 00000100:00100000:2.0:1788263463.167404:0:16378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753767424 00000100:00100000:2.0:1788263463.167429:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263463.167437:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753767296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.167494:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753767296:12345-0@lo:400:kworker.0 Request processed in 58us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.167500:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263463.167514:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263463.167520:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753767424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.167548:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753767424:12345-0@lo:400:kworker.0 Request processed in 30us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.167554:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788263463.167586:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263463.167589:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263463.167591:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263463.168533:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753767296:0@lo:400:kworker.0 00000100:00100000:1.0:1788263463.168554:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753767808:0@lo:400:kworker.0 00000100:00100000:1.0:1788263463.168565:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753767168:0@lo:400:kworker.0 00000100:00100000:1.0:1788263463.168576:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753767680:0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.168751:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753767552:0@lo:400:kworker.0 00000100:00100000:2.0:1788263463.168764:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753767424:0@lo:400:kworker.0 00000100:00100000:1.0:1788263463.169283:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753767936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263463.169349:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263463.170716:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753767936 00000100:00100000:2.0:1788263463.170725:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753767936 00000100:00100000:2.0:1788263463.170780:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263463.170788:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753767936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263463.170824:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263463.170892:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753767936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.170907:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263463.171524:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753767936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788263463.227422:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788263463.404133:0:16615:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff738965d0 20000000:00000080:3.0:1788263463.404154:0:16615:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99437f753000 uarg=0000000000000000 20000000:01000000:3.0:1788263463.404192:0:16615:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788263463.404198:0:16615:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788263463.404203:0:16615:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788263463.407042:0:16616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788263463.407705:0:16615:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788263463.416962:0:16615:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788263463.416997:0:16615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.417019:0:16615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956c39 expref: 18 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.417027:0:16615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956c86 expref: 18 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.417049:0:16615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956dba expref: 18 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.417059:0:16615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d341e expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.417066:0:16615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3480 expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.417074:0:16615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.417140:0:16615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3480 expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.417156:0:16615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3480 expref: 12 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263463.417172:0:16615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768064:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263463.418811:0:16615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d341e expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.418828:0:16615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d341e expref: 12 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263463.418841:0:16615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768192:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263463.418884:0:16615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513956dba expref: 18 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.418908:0:16615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513956dba expref: 18 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263463.418918:0:16615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768320:0@lo:104: 00000100:00100000:3.0:1788263463.418962:0:16615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263463.419017:0:16615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513956c86 expref: 18 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.419026:0:16615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513956c86 expref: 18 pid: 14490 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263463.419033:0:16615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768448:0@lo:104: 00000100:00100000:3.0:1788263463.419058:0:16615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263463.420609:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753768320 00000100:00100000:0.0:1788263463.420622:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753768320 00000100:00100000:0.0:1788263463.420668:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753768448 00000100:00100000:0.0:1788263463.420671:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753768448 00000100:00100000:0.0:1788263463.420689:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263463.420699:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+4:16615:x1875129753768320:12345-0@lo:104: 00010000:00010000:0.0:1788263463.420718:0:14480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.420791:0:14480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263463.420796:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+4:16615:x1875129753768320:12345-0@lo:104: Request processed in 99us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263463.420804:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263463.420823:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263463.420841:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+3:16615:x1875129753768448:12345-0@lo:104: 00010000:00010000:0.0:1788263463.420849:0:14480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.420886:0:14480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788263463.420891:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+3:16615:x1875129753768448:12345-0@lo:104: Request processed in 51us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263463.420897:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788263463.420918:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263463.420924:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.420931:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1200 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263463.420935:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.420944:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263463.420951:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263463.420956:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263463.420992:0:14485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.420998:0:14485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263463.421019:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.421036:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99437f6b1200/0x1a657bc513956dba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956dc1 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.421051:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263463.421054:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.421059:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b1c00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263463.421062:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.421068:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263463.421616:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263463.421626:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263463.421654:0:14485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.421660:0:14485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263463.421688:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.421698:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99437f6b1c00/0x1a657bc513956c86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956c8d expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.421708:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263463.421717:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263463.421719:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263463.421744:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753768576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263463.421796:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263463.421845:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263463.421853:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994346b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753768704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263463.421877:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263463.421912:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753768576 00000100:00100000:0.0:1788263463.421917:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753768576 00010000:00010000:0.0:1788263463.421940:0:14482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956dba expref: 19 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263463.421962:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753768704 00000100:00100000:0.0:1788263463.421964:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753768704 00010000:00010000:0.0:1788263463.421976:0:14482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956c86 expref: 20 pid: 14490 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263463.421988:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263463.421994:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+20:3321:x1875129753768576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263463.422005:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263463.422010:0:14482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956dba expref: 20 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.422020:0:14482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513956dba expref: 20 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.422036:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263463.422067:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+20:3321:x1875129753768576:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263463.422073:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263463.422111:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263463.422117:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753768704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263463.422126:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263463.422130:0:14482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956c86 expref: 19 pid: 14490 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.422138:0:14482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513956c86 expref: 19 pid: 14490 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.422148:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263463.422175:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753768704:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263463.422180:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788263463.422834:0:16615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513956c39 expref: 18 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263463.422848:0:16615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513956c39 expref: 18 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263463.422860:0:16615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768832:0@lo:104: 00000100:00100000:3.0:1788263463.422897:0:16615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263463.422928:0:16615:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435285ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1788263463.422943:0:16615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380658c00/0x1a657bc513956dc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513956dba expref: 18 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263463.422955:0:16615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768320:0@lo:104: 00010000:00010000:3.0:1788263463.422965:0:16615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380658a00/0x1a657bc513956c8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513956c86 expref: 17 pid: 14490 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263463.422987:0:16615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768448:0@lo:104: 00010000:00010000:2.0:1788263463.423790:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263463.426165:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753768576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263463.426271:0:14480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788263463.426299:0:14480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753768832 00000100:00100000:2.0:1788263463.426306:0:14480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753768832 00000100:00100000:2.0:1788263463.426360:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263463.426369:0:14480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+3:16615:x1875129753768832:12345-0@lo:104: 00010000:00010000:2.0:1788263463.426386:0:14480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263463.426475:0:14480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263463.426481:0:14480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+3:16615:x1875129753768832:12345-0@lo:104: Request processed in 114us (3584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.426488:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788263463.427461:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263463.427471:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263463.427480:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b0000 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:1.0:1788263463.427485:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263463.427510:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263463.427517:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263463.427522:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788263463.427577:0:14485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263463.427584:0:14485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263463.427601:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263463.427609:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99437f6b0000/0x1a657bc513956c39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513956c40 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263463.427625:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263463.427627:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263463.427628:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263463.427636:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263463.427652:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753768960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263463.427703:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263463.427951:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994346b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753768704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263463.428493:0:16615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768832:0@lo:104: 00000100:00100000:3.0:1788263463.428546:0:16615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768064:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263463.428559:0:16615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16615:1875129753768192:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263463.428573:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1788263463.428589:0:16615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263463.428645:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263463.428710:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753768960 00000100:00100000:0.0:1788263463.428716:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753768960 00010000:00010000:0.0:1788263463.428744:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956c39 expref: 17 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263463.428763:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735953024 00000100:00100000:0.0:1788263463.428766:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735953024 00010000:00010000:0.0:1788263463.428779:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d341e expref: 13 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263463.428790:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735952896 00000100:00100000:0.0:1788263463.428793:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735952896 00010000:00010000:0.0:1788263463.428805:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3480 expref: 14 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263463.428819:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263463.428837:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+17:3322:x1875129753768960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263463.428851:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263463.428856:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513956c39 expref: 17 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.428866:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513956c39 expref: 17 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.428881:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216ca00/0x1a657bc513956c40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513956c39 expref: 17 pid: 14491 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.428893:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263463.428946:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:91f17ece-9654-41b2-8823-2d6af9d5176a+16:3322:x1875129753768960:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263463.428953:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263463.429011:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1788263463.429018:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+14:2361:x1875129735953024:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263463.429026:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263463.429030:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d341e expref: 14 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429038:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d341e expref: 14 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429050:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216cc00/0x1a657bc513956ee7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d341e expref: 14 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429059:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263463.429106:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2361:x1875129735953024:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 88us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263463.429120:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1788263463.429135:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1788263463.429141:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:2361:x1875129735952896:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263463.429149:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263463.429153:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3480 expref: 12 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429163:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3480 expref: 12 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429174:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216c200/0x1a657bc513956f1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3480 expref: 12 pid: 14492 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429185:0:14483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429490:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429507:0:14483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429514:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429520:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429527:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429539:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263463.429543:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429550:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429566:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263463.429577:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263463.429600:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:2361:x1875129735952896:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 459us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263463.429607:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1788263463.430419:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753768960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263463.430432:0:16615:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263463.430443:0:16615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263463.430451:0:16615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343158200/0x1a657bc513956f49 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.251634:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788263464.512937:0:14494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788263464.512945:0:14494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9943803c6000 from 10 10000000:01000000:1.0:1788263464.512962:0:14494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263464.513017:0:14494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263464.513030:0:14494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263464.513042:0:14494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263464.513069:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263464.513146:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263464.513211:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff994377a87180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263464.513361:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753769088 00000100:00100000:2.0:1788263464.513377:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753769088 00000100:00100000:2.0:1788263464.513434:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788263464.513445:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+16:14494:x1875129753769088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263464.513458:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263464.513472:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d7a00/0x1a657bc513956f57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956f50 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.513494:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d7a00/0x1a657bc513956f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956f50 expref: 17 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.513505:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d7a00/0x1a657bc513956f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956f50 expref: 17 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.513514:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7a00, rc 0) 00000100:00100000:2.0:1788263464.513555:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+17:14494:x1875129753769088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.513561:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788263464.513603:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263464.513617:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.513624:0:14494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263464.513692:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.513718:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263464.513734:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434664e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263464.513747:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753769216 00000100:00100000:2.0:1788263464.513758:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753769216 00000100:00100000:2.0:1788263464.513782:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788263464.513787:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+17:14494:x1875129753769216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.514029:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+17:14494:x1875129753769216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.514036:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788263464.514066:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.514095:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.514132:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263464.514145:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434664e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263464.514157:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753769344 00000100:00100000:2.0:1788263464.514160:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753769344 00000100:00100000:2.0:1788263464.514190:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263464.514197:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+17:14494:x1875129753769344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.514379:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f558450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+17:14494:x1875129753769344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.514386:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263464.514423:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788263464.515016:0:16668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788263464.515068:0:14494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788263464.515082:0:14494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263464.515090:0:14494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.515098:0:14494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263464.515118:0:14494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263464.515121:0:14494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9943744b9800 from 10 10000000:01000000:2.0:1788263464.515123:0:14494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263464.515162:0:14494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.515169:0:14494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.515179:0:14494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263464.515194:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.515251:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263464.515268:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434664e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263464.515302:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753769472 00000100:00100000:2.0:1788263464.515306:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753769472 00000100:00100000:2.0:1788263464.515330:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788263464.515337:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+17:14494:x1875129753769472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263464.515346:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263464.515357:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d7200/0x1a657bc513956f65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956f5e expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.515376:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d7200/0x1a657bc513956f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956f5e expref: 18 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.515385:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d7200/0x1a657bc513956f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956f5e expref: 18 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.515404:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7200, rc 0) 00000100:00100000:2.0:1788263464.515439:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:14494:x1875129753769472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.515445:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788263464.515481:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263464.515494:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.515501:0:14494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263464.515555:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.515579:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263464.515592:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434664e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263464.515603:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753769600 00000100:00100000:2.0:1788263464.515606:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753769600 00000100:00100000:2.0:1788263464.515627:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788263464.515633:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f559050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:14494:x1875129753769600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.515834:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f559050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:14494:x1875129753769600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.515840:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788263464.515870:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.515919:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.515955:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263464.515976:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434664e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263464.515988:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753769728 00000100:00100000:2.0:1788263464.515991:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753769728 00000100:00100000:2.0:1788263464.516011:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788263464.516016:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:14494:x1875129753769728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.516142:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:14494:x1875129753769728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.516148:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788263464.516183:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788263464.531688:0:16669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788263464.532127:0:14494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788263464.532149:0:14494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263464.532161:0:14494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263464.532172:0:14494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263464.532190:0:14494:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788263464.532192:0:14494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99434660c800 from 10 10000000:01000000:3.0:1788263464.532195:0:14494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263464.532594:0:14494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263464.532604:0:14494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263464.532615:0:14494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263464.532640:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263464.532715:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263464.532850:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263464.534540:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753769856 00000100:00100000:2.0:1788263464.534551:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753769856 00000100:00100000:2.0:1788263464.534614:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788263464.534625:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:14494:x1875129753769856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263464.534640:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263464.534656:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d6200/0x1a657bc513956f73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513956f6c expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.534682:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d6200/0x1a657bc513956f73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513956f6c expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.534692:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d6200/0x1a657bc513956f73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513956f6c expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.534701:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6200, rc 0) 00000100:00100000:2.0:1788263464.534767:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f559c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:14494:x1875129753769856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.534774:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788263464.535057:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263464.535077:0:14494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263464.535086:0:14494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263464.535158:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263464.535285:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263464.535317:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263464.535459:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753769984 00000100:00100000:2.0:1788263464.535472:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753769984 00000100:00100000:2.0:1788263464.535532:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788263464.535539:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:14494:x1875129753769984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.535777:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f559850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:14494:x1875129753769984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.535785:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788263464.539953:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753769984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263464.540008:0:14494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753770112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263464.540078:0:14494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263464.540127:0:14494:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263464.540185:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753770112 00000100:00100000:2.0:1788263464.540191:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753770112 00000100:00100000:2.0:1788263464.540278:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788263464.540290:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:14494:x1875129753770112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.540478:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:14494:x1875129753770112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.540486:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788263464.540626:0:14494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:91f17ece-9654-41b2-8823-2d6af9d5176a:14494:1875129753770112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788263464.541420:0:16671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788263464.541682:0:14494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788263464.541700:0:14494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263464.541710:0:14494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.541720:0:14494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263464.741464:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263464.741539:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735953152 00000100:00100000:3.0:1788263464.741548:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735953152 00000100:00100000:3.0:1788263464.741601:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:3.0:1788263464.741611:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:13772:x1875129735953152:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263464.741627:0:14492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263464.741643:0:14492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343159e00/0x1a657bc513956f7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34b1 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263464.741687:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343159e00/0x1a657bc513956f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34b1 expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263464.741698:0:14492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343159e00/0x1a657bc513956f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34b1 expref: 12 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263464.741708:0:14492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159e00, rc 0) 00000100:00100000:3.0:1788263464.741762:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13772:x1875129735953152:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 152us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263464.741769:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:3.0:1788263464.752513:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263464.752624:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735953280 00000100:00100000:2.0:1788263464.752635:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735953280 00000100:00100000:2.0:1788263464.752698:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:2.0:1788263464.752709:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13772:x1875129735953280:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.753133:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f558050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13772:x1875129735953280:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 424us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.753153:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:1.0:1788263464.760706:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263464.760856:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735953408 00000100:00100000:3.0:1788263464.760865:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735953408 00000100:00100000:3.0:1788263464.760916:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1788263464.760926:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13772:x1875129735953408:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263464.761135:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13772:x1875129735953408:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 210us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263464.761143:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:0.0:1788263464.768554:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263464.770446:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735953536 00000100:00100000:3.0:1788263464.770461:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735953536 00000100:00100000:2.0:1788263464.773642:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:2.0:1788263464.773658:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f55b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:13772:x1875129735953536:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263464.773676:0:14490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263464.773694:0:14490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9943810d6a00/0x1a657bc513956f81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34b8 expref: -99 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.773723:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9943810d6a00/0x1a657bc513956f81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34b8 expref: 13 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.773734:0:14490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9943810d6a00/0x1a657bc513956f81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34b8 expref: 13 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263464.773743:0:14490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6a00, rc 0) 00000100:00100000:2.0:1788263464.773810:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f55b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13772:x1875129735953536:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 156us (5266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.773816:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:0.0:1788263464.790977:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263464.791069:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735953664 00000100:00100000:2.0:1788263464.791079:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735953664 00000100:00100000:2.0:1788263464.791140:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:2.0:1788263464.791152:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943820c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13772:x1875129735953664:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263464.791494:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943820c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13772:x1875129735953664:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 342us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263464.791504:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:2.0:1788263464.803822:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263464.803898:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735953792 00000100:00100000:3.0:1788263464.803909:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735953792 00000100:00100000:3.0:1788263464.803963:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1788263464.803974:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13772:x1875129735953792:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263464.804197:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:13772:x1875129735953792:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 224us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263464.804211:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:1.0:1788263465.211408:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263465.211590:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753770240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263465.211670:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263465.213087:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753770240 00000100:00100000:2.0:1788263465.213104:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753770240 00000100:00100000:2.0:1788263465.213287:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263465.213298:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753770240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263465.213337:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263465.213406:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753770240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263465.213413:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263465.213466:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753770240:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788263465.214639:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788263465.275416:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263466.299634:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263466.573477:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263466.573597:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735953920 00000100:00100000:2.0:1788263466.573607:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735953920 00000100:00100000:2.0:1788263466.573683:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1788263466.573694:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+6:14428:x1875129735953920:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263466.573714:0:14498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263466.573734:0:14498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34bf expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.573806:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.573820:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.573831:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.573845:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.573871:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.573879:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574197:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513956f9d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574206:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513956f9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574213:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513956f9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263466.574288:0:14498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263466.574291:0:14498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263466.574324:0:14498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513956f9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574334:0:14498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574340:0:14498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574346:0:14498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574352:0:14498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263466.574356:0:14498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574370:0:14498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574383:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9942419f8100) 00010000:00010000:2.0:1788263466.574386:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263466.574390:0:14498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574397:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956f8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574410:0:14498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574416:0:14498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574421:0:14498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574426:0:14498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263466.574429:0:14498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574435:0:14498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574442:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99434314fc00) 00010000:00010000:2.0:1788263466.574444:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263466.574446:0:14498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574461:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956f96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574496:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34bf expref: 8 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574509:0:14498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513956f9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34bf expref: 7 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.574516:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99434314f900) 00010000:00010000:2.0:1788263466.574519:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263466.574521:0:14498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6400, rc 0) 00000100:00100000:2.0:1788263466.574596:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+7:14428:x1875129735953920:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 904us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263466.574603:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00080000:0.0:1788263466.574871:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263466.586984:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263466.587571:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735954176 00000100:00100000:2.0:1788263466.587583:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735954176 00000100:00100000:2.0:1788263466.587642:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1788263466.587653:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+7:14428:x1875129735954176:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263466.587678:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263466.587700:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956fa4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34c6 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.587786:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.587801:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.587827:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590000:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590023:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590035:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590558:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc513956fb9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590570:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc513956fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590577:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc513956fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263466.590588:0:14497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788263466.590781:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590789:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590795:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590801:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263466.590811:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590819:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590832:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99434314f900) 00010000:00010000:3.0:1788263466.590835:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.590839:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590845:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513956fab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590857:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590863:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590869:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590873:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263466.590876:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590881:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590889:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff994352cd3700) 00010000:00010000:3.0:1788263466.590891:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.590900:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.590906:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fb2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.596322:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513956fa4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34c6 expref: 10 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.596353:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc513956fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34c6 expref: 9 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.596363:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:3.0:1788263466.596367:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.596370:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159400, rc 0) 00000100:00100000:3.0:1788263466.596451:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+9:14428:x1875129735954176:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 8798us (9489us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788263466.596461:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788263466.600777:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263466.600885:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735954304 00000100:00100000:2.0:1788263466.600896:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735954304 00000100:00100000:2.0:1788263466.600956:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1788263466.600967:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+9:14428:x1875129735954304:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788263466.601093:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+9:14428:x1875129735954304:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 126us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263466.601100:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788263466.630443:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263466.630500:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735954432 00000100:00100000:3.0:1788263466.630510:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735954432 00000100:00100000:3.0:1788263466.630619:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788263466.630630:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+9:14434:x1875129735954432:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263466.630650:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263466.630669:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513956fc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34cd expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.630735:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.630768:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.630780:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.630795:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.630803:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.630810:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631011:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631019:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631025:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631030:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263466.631034:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631041:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631054:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9942419f8100) 00010000:00010000:3.0:1788263466.631062:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.631067:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631073:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513956fce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631085:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631091:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631097:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631102:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263466.631105:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631111:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631119:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994352cd3700) 00010000:00010000:3.0:1788263466.631122:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.631125:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631130:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956fd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631173:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513956fc7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34cd expref: 10 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631190:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9942419f8100) 00010000:00010000:3.0:1788263466.631193:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.631197:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513956fc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34cd expref: 10 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.631206:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159800, rc 0) 00000100:00100000:3.0:1788263466.631398:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+9:14434:x1875129735954432:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 768us (960us total) trans 0 rc 301/301 00000100:00100000:3.0:1788263466.631405:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788263466.635345:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263466.635597:0:14506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735954560 00000100:00100000:2.0:1788263466.635607:0:14506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735954560 00000100:00100000:2.0:1788263466.635658:0:14506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788263466.635668:0:14506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aaa94f48-2848-4430-a76d-a41ea14a2177+9:14434:x1875129735954560:12345-192.168.201.29@tcp:700:lfs.0 00000100:00100000:2.0:1788263466.635751:0:14506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aaa94f48-2848-4430-a76d-a41ea14a2177+9:14434:x1875129735954560:12345-192.168.201.29@tcp:700:lfs.0 Request processed in 84us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263466.635760:0:14506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788263466.638123:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263466.638372:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735954816 00000100:00100000:2.0:1788263466.638382:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735954816 00000100:00100000:2.0:1788263466.638441:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1788263466.638452:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+9:14434:x1875129735954816:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:2.0:1788263466.638507:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263466.638535:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382043a00/0x1a657bc513956f0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3448 expref: 9 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.638574:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9942419f8100) 00010000:00010000:2.0:1788263466.638579:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263466.638784:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.638798:0:14498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34aa expref: 5 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.638806:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.638839:0:14498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34aa expref: 5 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.638852:0:14498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34aa expref: 5 pid: 14499 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263466.638866:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14498:1875129753770368:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263466.638955:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff994343b2a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788263466.646610:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263466.646716:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735954944 00000100:00100000:1.0:1788263466.646725:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735954944 00010000:00010000:1.0:1788263466.646782:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34aa expref: 6 pid: 14499 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263466.646826:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1788263466.646836:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2361:x1875129735954944:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263466.646849:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263466.646855:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34aa expref: 6 pid: 14499 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.646887:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34aa expref: 6 pid: 14499 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.646909:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9942419f8100) 00010000:00010000:1.0:1788263466.646914:0:14483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.646922:0:14483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.646929:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.646947:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263466.647010:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2361:x1875129735954944:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 175us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263466.647018:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00010000:00010000:2.0:1788263466.647671:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc513956f42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34aa expref: 5 pid: 14499 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263466.647691:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943810d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14498:1875129753770368:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263466.647710:0:14498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.647719:0:14498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.647732:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.647755:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.647763:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.647772:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788263466.649607:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788263466.649945:0:14498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788263466.649961:0:14498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.650275:0:14498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.650285:0:14498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.650291:0:14498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263466.650296:0:14498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.650303:0:14498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.650321:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9942419f8100) 00010000:00010000:2.0:1788263466.650324:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263466.650337:0:14498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.650343:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fdc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263466.650367:0:14498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015ea018d reply state 0000000078d1b0a6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263466.650378:0:14498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263466.650532:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+10:14434:x1875129735954816:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 12078us (12413us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788263466.650541:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:2.0:1788263466.662962:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.662995:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.663004:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.663011:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263466.663016:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.663024:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.663043:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99434314fc00) 00010000:00010000:2.0:1788263466.663046:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263466.663049:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.663071:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956fe3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263466.715942:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263466.716277:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735955072 00000100:00100000:3.0:1788263466.716288:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735955072 00000100:00100000:3.0:1788263466.716354:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1788263466.716365:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+9:14442:x1875129735955072:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:3.0:1788263466.716390:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263466.716415:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513956fea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34d4 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.716482:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956ff1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.716498:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.716510:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263466.716546:0:14497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788263466.716562:0:14497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263466.716607:0:14497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.716634:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513956fea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34d4 expref: 11 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.716656:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34d4 expref: 10 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.716666:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:3.0:1788263466.716669:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263466.716674:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158a00, rc 0) 00000100:00100000:3.0:1788263466.716867:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+10:14442:x1875129735955072:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 503us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263466.716875:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788263466.729770:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263466.729812:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263466.729851:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263466.729898:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263466.729917:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263466.730014:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735955200 00000100:00100000:1.0:1788263466.730024:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735955200 00000100:00100000:1.0:1788263466.730086:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:1.0:1788263466.730097:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2360:x1875129735955200:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263466.730607:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2360:x1875129735955200:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 510us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263466.730618:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:1.0:1788263466.730655:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735955328 00000100:00100000:1.0:1788263466.730660:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735955328 00000100:00100000:1.0:1788263466.730699:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735955584 00000100:00100000:1.0:1788263466.730703:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735955584 00000100:00100000:1.0:1788263466.730715:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735955456 00000100:00100000:1.0:1788263466.730718:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735955456 00000100:00100000:1.0:1788263466.730728:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735955712 00000100:00100000:1.0:1788263466.730730:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735955712 00000100:00100000:1.0:1788263466.730742:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788263466.730749:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735955328:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263466.730780:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735955328:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 32us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263466.730787:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788263466.730798:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788263466.730804:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2360:x1875129735955584:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263466.730824:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2360:x1875129735955584:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 20us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263466.730830:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788263466.730840:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:1.0:1788263466.730845:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735955456:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263466.730867:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735955456:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263466.730873:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:1.0:1788263466.730884:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1788263466.730890:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2360:x1875129735955712:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263466.730910:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2360:x1875129735955712:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 21us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263466.730925:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00080000:1.0:1788263466.730942:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263466.730946:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263466.739355:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263466.739450:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735955840 00000100:00100000:2.0:1788263466.739460:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735955840 00000100:00100000:2.0:1788263466.739513:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788263466.739523:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:14443:x1875129735955840:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263466.739542:0:14498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263466.739560:0:14498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956ff8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34db expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.739624:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.739638:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.739650:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263466.739684:0:14498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263466.739687:0:14498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263466.739704:0:14498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.739725:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513956ff8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34db expref: 7 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.739741:0:14498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34db expref: 6 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.739761:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:2.0:1788263466.739764:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263466.739768:0:14498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7c00, rc 0) 00000100:00100000:2.0:1788263466.739824:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:14443:x1875129735955840:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 302us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263466.739831:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788263466.745175:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263466.745318:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735955968 00000100:00100000:3.0:1788263466.745327:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735955968 00000100:00100000:3.0:1788263466.745384:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1788263466.745394:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:14443:x1875129735955968:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263466.745415:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263466.745435:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957006 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34e2 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745496:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745510:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745536:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745552:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745560:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745567:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745698:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395701b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745707:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395701b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745714:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395701b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263466.745743:0:14497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788263466.745747:0:14497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263466.745765:0:14497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395701b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745777:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745785:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745801:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745808:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263466.745813:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745821:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745833:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:3.0:1788263466.745836:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.745840:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745847:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395700d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745859:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745864:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745869:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745874:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263466.745877:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745895:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745903:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994352cd3f00) 00010000:00010000:3.0:1788263466.745905:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.745907:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745913:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957014 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745943:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957006 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34e2 expref: 8 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745957:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395701b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34e2 expref: 7 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.745964:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994352cd3200) 00010000:00010000:3.0:1788263466.745966:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263466.745969:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158c00, rc 0) 00000100:00100000:3.0:1788263466.746049:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+7:14443:x1875129735955968:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 656us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263466.746056:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000040:00080000:2.0:1788263466.747940:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788263466.751787:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263466.751875:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735956224 00000100:00100000:3.0:1788263466.751885:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735956224 00000100:00100000:3.0:1788263466.751946:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:3.0:1788263466.751958:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+7:14443:x1875129735956224:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263466.752005:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263466.752025:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957022 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34e9 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263466.752115:0:14499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788263466.752280:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957022 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34e9 expref: 9 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.752296:0:14499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:3.0:1788263466.752299:0:14499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263466.752305:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957022 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34e9 expref: 9 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.752318:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159800, rc 0) 00000100:00100000:3.0:1788263466.752549:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+8:14443:x1875129735956224:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 592us (773us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788263466.752557:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1788263466.755548:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263466.755659:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735956480 00000100:00100000:2.0:1788263466.755669:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735956480 00000100:00100000:2.0:1788263466.755751:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1788263466.755762:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+8:14443:x1875129735956480:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:2.0:1788263466.755816:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263466.755840:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395701b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34e2 expref: 8 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.755857:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994352cd3200) 00010000:00010000:2.0:1788263466.755867:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263466.755890:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.755903:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.755911:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263466.756125:0:14498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007de907b6 reply state 000000006c5dcf3f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263466.756286:0:14498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788263466.756294:0:14498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788263466.756417:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+9:14443:x1875129735956480:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 656us (878us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788263466.756425:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:1.0:1788263466.758814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263466.759331:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735956736 00000100:00100000:2.0:1788263466.759341:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735956736 00000100:00100000:2.0:1788263466.759399:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788263466.759410:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+9:14443:x1875129735956736:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263466.759633:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+10:14443:x1875129735956736:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 223us (830us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788263466.759641:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1788263466.763346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263466.763530:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735956992 00000100:00100000:1.0:1788263466.763539:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735956992 00000100:00100000:1.0:1788263466.763596:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1788263466.763606:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+10:14443:x1875129735956992:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263466.763632:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263466.763655:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34f0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.763736:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.763750:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.763761:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.763775:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.763782:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.763789:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263466.763912:0:14499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788263466.763991:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764000:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764007:0:14499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764012:0:14499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263466.764017:0:14499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764025:0:14499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764036:0:14499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:1.0:1788263466.764039:0:14499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263466.764043:0:14499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764048:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc51395703e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764059:0:14499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764065:0:14499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764081:0:14499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764086:0:14499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263466.764089:0:14499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764095:0:14499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764102:0:14499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9943435a7b00) 00010000:00010000:1.0:1788263466.764104:0:14499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263466.764107:0:14499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764112:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957045 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764166:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957037 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f0 expref: 12 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764178:0:14499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:1.0:1788263466.764180:0:14499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263466.764184:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f0 expref: 12 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.764193:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899a00, rc 0) 00000100:00100000:1.0:1788263466.764288:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+11:14443:x1875129735956992:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 682us (951us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788263466.764304:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788263466.768948:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263466.769041:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735957120 00000100:00100000:1.0:1788263466.769052:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735957120 00000100:00100000:1.0:1788263466.769112:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1788263466.769123:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+11:14443:x1875129735957120:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263466.769164:0:14498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263466.769185:0:14498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898e00/0x1a657bc513957053 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34f7 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.769307:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.769321:0:14498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.769329:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.769347:0:14498:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.769357:0:14498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.769965:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.770020:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.770028:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.770033:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263466.770037:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.770044:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.770079:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:2.0:1788263466.770082:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788263466.770086:0:3307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.770093:0:3307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.770099:0:3307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.770251:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263466.770261:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957030 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.770372:0:14498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.770381:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263466.770423:0:14498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788263466.770427:0:14498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263466.770443:0:14498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.770474:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898e00/0x1a657bc513957053 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f7 expref: 12 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.770488:0:14498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f7 expref: 11 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.770496:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263466.770499:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263466.770501:0:14498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899000, rc 0) 00000100:00100000:1.0:1788263466.770619:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+11:14443:x1875129735957120:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1497us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263466.770628:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:0.0:1788263466.774740:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263466.774825:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735957248 00000100:00100000:2.0:1788263466.774834:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735957248 00000100:00100000:2.0:1788263466.774920:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788263466.774932:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+11:14443:x1875129735957248:12345-192.168.201.29@tcp:37:lfs.0 00000100:00100000:0.0:1788263466.780089:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+11:14443:x1875129735957248:12345-192.168.201.29@tcp:37:lfs.0 Request processed in 5147us (5346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263466.780103:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788263466.784447:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263466.784513:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735957504 00000100:00100000:1.0:1788263466.784523:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735957504 00000100:00100000:1.0:1788263466.784572:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:1.0:1788263466.784582:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994374434050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+11:14443:x1875129735957504:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788263466.784817:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994374434050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+12:14443:x1875129735957504:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 235us (382us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788263466.784826:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:1.0:1788263466.830542:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263466.830645:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735957632 00000100:00100000:3.0:1788263466.830655:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735957632 00000100:00100000:3.0:1788263466.830720:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:3.0:1788263466.830730:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+10:14449:x1875129735957632:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788263466.830751:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263466.831322:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d34fe expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831385:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831415:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831427:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831441:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831447:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831453:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831530:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513957076 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831537:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513957076 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831544:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513957076 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263466.831567:0:14497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788263466.831570:0:14497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263466.831605:0:14497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513957076 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831616:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831631:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831639:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831645:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263466.831649:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831656:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831668:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:3.0:1788263466.831671:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.831675:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831682:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831693:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831699:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831705:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831710:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263466.831716:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831722:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831729:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff994352cd3f00) 00010000:00010000:3.0:1788263466.831731:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263466.831734:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831739:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395706f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831766:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34fe expref: 12 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831777:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513957076 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34fe expref: 11 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.831784:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263466.831786:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788263466.831788:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158000, rc 0) 00000100:00100000:3.0:1788263466.831853:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+11:14449:x1875129735957632:12345-192.168.201.29@tcp:101:bash.0 Request processed in 1124us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263466.831861:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:2.0:1788263466.835656:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263466.835760:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735957888 00000100:00100000:1.0:1788263466.835782:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735957888 00000100:00100000:1.0:1788263466.835847:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1788263466.835857:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+11:14449:x1875129735957888:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788263466.835882:0:14498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263466.835904:0:14498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898e00/0x1a657bc51395707d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3505 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.836154:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.836169:0:14498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f7 expref: 11 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.836179:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.836214:0:14498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f7 expref: 11 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.836442:0:14498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f7 expref: 11 pid: 14498 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263466.836458:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f508380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14498:1875129753770496:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263466.836609:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff994377a87d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263466.840870:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263466.841176:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735958016 00000100:00100000:3.0:1788263466.841186:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735958016 00010000:00010000:3.0:1788263466.841273:0:14484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f7 expref: 12 pid: 14498 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263466.841339:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263466.841350:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+12:2362:x1875129735958016:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263466.841365:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263466.841372:0:14484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f7 expref: 12 pid: 14498 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.841385:0:14484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f7 expref: 12 pid: 14498 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.841407:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263466.841411:0:14484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.841422:0:14484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.841430:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.841448:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263466.841504:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+12:2362:x1875129735958016:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 155us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263466.841511:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00010000:00010000:1.0:1788263466.842797:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc51395705a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34f7 expref: 11 pid: 14498 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263466.842820:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f508380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14498:1875129753770496:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263466.842857:0:14498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.842867:0:14498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.842873:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.842898:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.842909:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.842918:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.843859:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.843871:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.843880:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263466.843893:0:14498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788263466.843920:0:14498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.843927:0:14498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.843946:0:14498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.843952:0:14498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263466.843956:0:14498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.843964:0:14498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.843994:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:1.0:1788263466.843997:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263466.844002:0:14498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.844009:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957084 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263466.844021:0:14498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aca5c775 reply state 0000000070c6b61f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263466.844030:0:14498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788263466.844068:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898e00/0x1a657bc51395707d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3505 expref: 14 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.844083:0:14498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3505 expref: 13 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.844091:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:1.0:1788263466.844099:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788263466.844102:0:14498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899800, rc 0) 00000100:00100000:1.0:1788263466.844582:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+14:14449:x1875129735957888:12345-192.168.201.29@tcp:101:bash.0 Request processed in 8723us (8934us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788263466.844592:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00010000:00010000:1.0:1788263466.852540:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.852560:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.852569:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.852576:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263466.852581:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.852589:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.852607:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9943435a7b00) 00010000:00010000:1.0:1788263466.852610:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263466.852615:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.852622:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395708b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263466.857832:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263466.858049:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735958144 00000100:00100000:3.0:1788263466.858060:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735958144 00000100:00100000:3.0:1788263466.858116:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:3.0:1788263466.858126:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+13:14449:x1875129735958144:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788263466.858177:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263466.858200:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139570a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d350c expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.858306:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.858320:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.858332:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263466.858371:0:14497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788263466.858376:0:14497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263466.858397:0:14497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.858408:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.858434:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139570a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d350c expref: 15 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.858452:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d350c expref: 14 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263466.858461:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:3.0:1788263466.858464:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263466.858467:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159000, rc 0) 00000100:00100000:3.0:1788263466.858528:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+14:14449:x1875129735958144:12345-192.168.201.29@tcp:101:bash.0 Request processed in 403us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263466.858535:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788263466.861767:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263466.861865:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735958400 00000100:00100000:1.0:1788263466.861875:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735958400 00000100:00100000:1.0:1788263466.861952:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788263466.861964:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943810d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+14:14449:x1875129735958400:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:1.0:1788263466.862400:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943810d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+15:14449:x1875129735958400:12345-192.168.201.29@tcp:35:bash.0 Request processed in 435us (638us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788263466.862409:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:0.0:1788263466.957659:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263466.962482:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735958656 00000100:00100000:1.0:1788263466.962498:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735958656 00000100:00100000:1.0:1788263466.962653:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:1.0:1788263466.962666:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+15:14459:x1875129735958656:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263466.962691:0:14498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263466.962711:0:14498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3513 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263466.962808:0:14498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788263466.962927:0:14498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3513 expref: 17 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.962943:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:1.0:1788263466.962946:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263466.962951:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3513 expref: 17 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263466.962966:0:14498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898600, rc 0) 00000100:00100000:1.0:1788263466.963056:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+16:14459:x1875129735958656:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 392us (5406us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788263466.963064:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1788263466.973613:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263466.973795:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735958912 00000100:00100000:1.0:1788263466.973817:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735958912 00000100:00100000:1.0:1788263466.973867:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1788263466.973876:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+16:14459:x1875129735958912:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788263466.974340:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+17:14459:x1875129735958912:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 462us (736us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788263466.974348:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788263467.015998:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.016123:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735959168 00000100:00100000:1.0:1788263467.016133:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735959168 00000100:00100000:1.0:1788263467.016201:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1788263467.016213:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+17:14462:x1875129735959168:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263467.016280:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263467.016302:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d351a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.016402:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898e00/0x1a657bc5139570c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.016416:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242898e00/0x1a657bc5139570c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.016427:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898e00/0x1a657bc5139570c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263467.016437:0:14499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788263467.016557:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570bc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d351a expref: 20 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.016574:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898e00/0x1a657bc5139570c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d351a expref: 19 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.016599:0:14499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:1.0:1788263467.016602:0:14499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263467.016606:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898e00, rc 0) 00000100:00100000:1.0:1788263467.016662:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+19:14462:x1875129735959168:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 451us (674us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788263467.016669:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:0.0:1788263467.019576:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.019757:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735959424 00000100:00100000:3.0:1788263467.019767:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735959424 00000100:00100000:3.0:1788263467.019835:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263467.019846:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+19:2359:x1875129735959424:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263467.019861:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263467.019886:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898e00/0x1a657bc5139570c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d351a expref: 19 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.019906:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:3.0:1788263467.019911:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263467.019986:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+18:2359:x1875129735959424:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 142us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.019995:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263467.021043:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.021285:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735959296 00000100:00100000:1.0:1788263467.021293:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735959296 00000100:00100000:1.0:1788263467.021338:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1788263467.021346:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+18:14462:x1875129735959296:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:1.0:1788263467.021414:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.021430:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.021442:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.021473:0:14498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.021480:0:14498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.021487:0:14498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.021493:0:14498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263467.021510:0:14498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.021518:0:14498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.021529:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:1.0:1788263467.021532:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263467.021536:0:14498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.021542:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263467.021597:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+18:14462:x1875129735959296:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 251us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.021604:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:3.0:1788263467.023746:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.023827:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735959680 00000100:00100000:1.0:1788263467.023838:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735959680 00000100:00100000:1.0:1788263467.023894:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788263467.023906:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+18:14462:x1875129735959680:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788263467.024180:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+19:14462:x1875129735959680:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 276us (444us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788263467.024188:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1788263467.312924:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.313105:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735959936 00000100:00100000:1.0:1788263467.313117:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735959936 00000100:00100000:1.0:1788263467.313194:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788263467.313205:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+19:14493:x1875129735959936:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:1.0:1788263467.313272:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263467.313305:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3521 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.313399:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.313412:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.313426:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263467.313436:0:14499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788263467.313569:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc5139570d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3521 expref: 22 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.313589:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3521 expref: 21 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.313598:0:14499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:1.0:1788263467.313600:0:14499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263467.313604:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898600, rc 0) 00000100:00100000:1.0:1788263467.313662:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+21:14493:x1875129735959936:12345-192.168.201.29@tcp:101:cat.0 Request processed in 459us (747us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788263467.313669:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1788263467.317659:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.317741:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735960192 00000100:00100000:1.0:1788263467.317749:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735960192 00000100:00100000:1.0:1788263467.317799:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1788263467.317807:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+21:14493:x1875129735960192:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:1.0:1788263467.318141:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+22:14493:x1875129735960192:12345-192.168.201.29@tcp:35:cat.0 Request processed in 333us (489us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788263467.318146:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788263467.319467:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263467.319578:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735960320 00000100:00100000:0.0:1788263467.319588:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735960320 00000100:00100000:0.0:1788263467.319684:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1788263467.319694:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+22:2359:x1875129735960320:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263467.319709:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263467.319734:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc5139570df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3521 expref: 22 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.319753:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:0.0:1788263467.319757:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263467.320101:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+21:2359:x1875129735960320:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 407us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.320110:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00010000:00010000:1.0:1788263467.323457:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263467.385430:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.385525:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735960576 00000100:00100000:3.0:1788263467.385536:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735960576 00000100:00100000:3.0:1788263467.385598:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1788263467.385609:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+21:14499:x1875129735960576:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:3.0:1788263467.385635:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263467.385655:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139570ed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3528 expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.385776:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.385792:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3505 expref: 22 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.385801:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d350c expref: 22 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.385809:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.385844:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d350c expref: 22 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.385858:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d350c expref: 22 pid: 14497 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.385872:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14497:1875129753770624:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263467.385999:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3505 expref: 22 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.386009:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3505 expref: 22 pid: 14498 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.386022:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14497:1875129753770752:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263467.386057:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce900 going to sleep for 11 seconds 00000100:00100000:3.0:1788263467.390466:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14497:1875129753770624:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263467.390485:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14497:1875129753770752:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263467.390515:0:14497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263467.392404:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.392942:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735960704 00000100:00100000:3.0:1788263467.392952:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735960704 00010000:00010000:3.0:1788263467.393013:0:14484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d350c expref: 23 pid: 14497 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.393058:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788263467.393069:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+23:2362:x1875129735960704:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263467.393086:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263467.393093:0:14484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d350c expref: 23 pid: 14497 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.393108:0:14484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d350c expref: 23 pid: 14497 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.393129:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139570a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d350c expref: 23 pid: 14497 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.393146:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:3.0:1788263467.393151:0:14484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.393178:0:14484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.393185:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263467.393315:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ec3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+22:2362:x1875129735960704:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 247us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.393324:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788263467.395897:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263467.396395:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735960832 00000100:00100000:0.0:1788263467.396407:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735960832 00010000:00010000:0.0:1788263467.396451:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3505 expref: 22 pid: 14498 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263467.396493:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788263467.396502:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+22:2362:x1875129735960832:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263467.396518:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263467.396525:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3505 expref: 22 pid: 14498 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.396537:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3505 expref: 22 pid: 14498 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.396559:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899800/0x1a657bc513957092 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3505 expref: 22 pid: 14498 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.396576:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:0.0:1788263467.396580:0:14483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.396591:0:14483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.396599:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.397527:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263467.397593:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+21:2362:x1875129735960832:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 1089us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.397602:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00010000:00010000:2.0:1788263467.398728:0:14497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.398742:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263467.398765:0:14497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788263467.398955:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139570ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3528 expref: 22 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.399062:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3528 expref: 21 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.399073:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:2.0:1788263467.399076:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788263467.399079:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159200, rc 0) 00000100:00100000:2.0:1788263467.399326:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+21:14499:x1875129735960576:12345-192.168.201.29@tcp:101:dd.0 Request processed in 13718us (13907us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788263467.399335:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:2.0:1788263467.404924:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.405013:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735961088 00000100:00100000:1.0:1788263467.405023:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735961088 00000100:00100000:1.0:1788263467.405084:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:1.0:1788263467.405095:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+21:14499:x1875129735961088:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:1.0:1788263467.405423:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.405441:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.405452:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263467.405503:0:14498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788263467.405539:0:14498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e5a8832 reply state 0000000079361955 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263467.405548:0:14498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263467.405704:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14499:x1875129735961088:12345-192.168.201.29@tcp:36:dd.0 Request processed in 608us (789us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788263467.405711:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000020:00080000:1.0:1788263467.405716:0:14498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788263467.408871:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.409207:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735961216 00000100:00100000:3.0:1788263467.409261:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735961216 00000100:00100000:3.0:1788263467.409322:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1788263467.409333:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14499:x1875129735961216:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:3.0:1788263467.409360:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263467.409382:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513957109 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d352f expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.409446:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513957109 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d352f expref: 25 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.409460:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513957109 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d352f expref: 25 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.409478:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:3.0:1788263467.409481:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263467.409486:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159000, rc 0) 00000100:00100000:3.0:1788263467.409538:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+25:14499:x1875129735961216:12345-192.168.201.29@tcp:101:dd.0 Request processed in 207us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.409544:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00010000:00010000:2.0:1788263467.414854:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.414876:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.414884:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.414891:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263467.414912:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.414921:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.414944:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:2.0:1788263467.414948:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263467.414952:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.414960:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899000/0x1a657bc513957102 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263467.419883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.419972:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735961472 00000100:00100000:3.0:1788263467.419982:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735961472 00000100:00100000:3.0:1788263467.420046:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1788263467.420057:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14499:x1875129735961472:12345-192.168.201.29@tcp:103:dd.0 00010000:00010000:3.0:1788263467.420072:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263467.420097:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513957109 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d352f expref: 24 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.420117:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:3.0:1788263467.420134:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263467.420184:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+23:14499:x1875129735961472:12345-192.168.201.29@tcp:103:dd.0 Request processed in 129us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.420192:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1788263467.422907:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.422996:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735961600 00000100:00100000:3.0:1788263467.423006:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735961600 00000100:00100000:3.0:1788263467.423064:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1788263467.423074:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+23:14499:x1875129735961600:12345-192.168.201.29@tcp:58:dd.0 00010000:00010000:3.0:1788263467.423184:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.423203:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.423455:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263467.424522:0:14499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263467.424691:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788263467.424767:0:14499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788263467.424979:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+23:14499:x1875129735961600:12345-192.168.201.29@tcp:58:dd.0 Request processed in 1900us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.424990:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:1.0:1788263467.431978:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263467.432077:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735961728 00000100:00100000:2.0:1788263467.432089:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735961728 00000100:00100000:2.0:1788263467.432368:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:2.0:1788263467.432379:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+23:14499:x1875129735961728:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:2.0:1788263467.432403:0:14498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263467.432426:0:14498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513957117 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3536 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.432483:0:14498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.432494:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513957117 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3536 expref: 24 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.432513:0:14498:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.432547:0:14498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513957117 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3536 expref: 24 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.432562:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:2.0:1788263467.432565:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263467.432569:0:14498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513957117 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3536 expref: 24 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.432577:0:14498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7000, rc 0) 00000100:00100000:2.0:1788263467.432644:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14499:x1875129735961728:12345-192.168.201.29@tcp:101:dd.0 Request processed in 266us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.432651:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000040:00080000:2.0:1788263467.771521:0:14531:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788263467.771532:0:14531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263467.771573:0:14531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788263467.771582:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788263467.771721:0:14531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14531:1875129753770880:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788263467.771840:0:14531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943450cc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263467.774479:0:14531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14531:1875129753770880:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788263467.779806:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.780703:0:14508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735961856 00000100:00100000:3.0:1788263467.780715:0:14508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735961856 00000100:00100000:3.0:1788263467.780779:0:14508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263467.780806:0:14508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14500:x1875129735961856:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788263467.780911:0:14508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14500:x1875129735961856:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 Request processed in 107us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.780919:0:14508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1788263467.791810:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263467.803060:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735961984 00000100:00100000:0.0:1788263467.803078:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735961984 00000100:00100000:0.0:1788263467.803166:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1788263467.803178:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14500:x1875129735961984:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788263467.803716:0:14499:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788263467.815304:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14500:x1875129735961984:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 12116us (23494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.815332:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:1.0:1788263467.818821:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263467.819273:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735962112 00000100:00100000:2.0:1788263467.819284:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735962112 00000100:00100000:2.0:1788263467.819344:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:2.0:1788263467.819354:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14500:x1875129735962112:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788263467.819426:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819461:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819474:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819530:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819538:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819544:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819568:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819576:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819583:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263467.819621:0:14498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788263467.819626:0:14498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263467.819638:0:14498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819650:0:14498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819667:0:14498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819673:0:14498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819680:0:14498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263467.819684:0:14498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819691:0:14498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819705:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:2.0:1788263467.819708:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263467.819713:0:14498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819719:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc51395711e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819733:0:14498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819740:0:14498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819745:0:14498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819750:0:14498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263467.819760:0:14498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819766:0:14498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819774:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff99434314f200) 00010000:00010000:2.0:1788263467.819776:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263467.819779:0:14498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819785:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc513957125 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819799:0:14498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819805:0:14498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819810:0:14498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819815:0:14498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263467.819817:0:14498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819823:0:14498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819831:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:2.0:1788263467.819833:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263467.819842:0:14498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.819848:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6600/0x1a657bc51395712c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.822410:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14500:x1875129735962112:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 3041us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.822425:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:0.0:1788263467.830722:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.830909:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735962368 00000100:00100000:1.0:1788263467.830920:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735962368 00000100:00100000:3.0:1788263467.831282:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:3.0:1788263467.831297:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+24:14500:x1875129735962368:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263467.831320:0:14497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263467.831344:0:14497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513957133 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d353d expref: -99 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831452:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831467:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831479:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263467.831489:0:14497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788263467.831589:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831596:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831604:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831630:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263467.831635:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831643:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831657:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:3.0:1788263467.831660:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788263467.831665:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831671:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc51395713a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831717:0:14497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513957133 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d353d expref: 26 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831727:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:3.0:1788263467.831730:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263467.831733:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc513957133 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d353d expref: 26 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.831742:0:14497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159000, rc 0) 00000100:00100000:3.0:1788263467.831820:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+25:14500:x1875129735962368:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 527us (1108us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788263467.831828:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1788263467.839829:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263467.840050:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735962496 00000100:00100000:2.0:1788263467.840060:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735962496 00000100:00100000:2.0:1788263467.840135:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:2.0:1788263467.840147:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+25:14500:x1875129735962496:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788263467.840186:0:14498:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788263467.840328:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+25:14500:x1875129735962496:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 183us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.840336:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1788263467.843651:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.843797:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735962752 00000100:00100000:1.0:1788263467.843807:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735962752 00000100:00100000:1.0:1788263467.843864:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:1.0:1788263467.843876:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+25:14500:x1875129735962752:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263467.843909:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263467.843930:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898800/0x1a657bc513957148 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3544 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788263467.844553:0:14499:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:1.0:1788263467.844560:0:14499:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788263467.844602:0:14499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1788263467.844845:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898c00/0x1a657bc51395714f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.844861:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242898c00/0x1a657bc51395714f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.844873:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898c00/0x1a657bc51395714f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.844928:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898800/0x1a657bc513957148 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3544 expref: 28 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.844945:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898c00/0x1a657bc51395714f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3544 expref: 27 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.844960:0:14499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9943435a7b00) 00010000:00010000:1.0:1788263467.844963:0:14499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263467.844967:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898c00, rc 0) 00000100:00100000:1.0:1788263467.845020:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+27:14500:x1875129735962752:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1147us (1378us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788263467.845027:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1788263467.854784:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.854874:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735963008 00000100:00100000:3.0:1788263467.854909:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735963008 00000100:00100000:3.0:1788263467.854978:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:3.0:1788263467.854990:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+27:14500:x1875129735963008:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263467.855048:0:14497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263467.855078:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898c00/0x1a657bc51395714f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3544 expref: 27 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855098:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9943435a7b00) 00010000:00010000:3.0:1788263467.855107:0:14497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263467.855141:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855154:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855163:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855176:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855183:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855190:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855325:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855334:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855347:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855353:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263467.855357:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855366:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855375:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263467.855378:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263467.855382:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855388:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395715d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855398:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855404:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855409:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855414:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263467.855418:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855433:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855441:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7c6d5bf (ffff994352cd3f00) 00010000:00010000:3.0:1788263467.855444:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263467.855447:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.855453:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957164 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7c6d5bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.856080:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+26:14500:x1875129735963008:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1088us (1302us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788263467.856089:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:0.0:1788263467.868302:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263467.868725:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735963136 00000100:00100000:2.0:1788263467.868734:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735963136 00000100:00100000:2.0:1788263467.868790:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1788263467.868801:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+26:14500:x1875129735963136:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263467.868823:0:14498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263467.868845:0:14498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395716b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d354b expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.868878:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513957172 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.868888:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513957172 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.868914:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513957172 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.869005:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc51395716b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d354b expref: 28 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.869020:0:14498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513957172 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d354b expref: 27 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.869027:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:2.0:1788263467.869029:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788263467.869032:0:14498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6000, rc 0) 00000100:00100000:2.0:1788263467.869099:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+27:14500:x1875129735963136:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 299us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.869106:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1788263467.872105:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.872316:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735963392 00000100:00100000:3.0:1788263467.872327:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735963392 00000100:00100000:3.0:1788263467.872414:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:3.0:1788263467.872425:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+27:14500:x1875129735963392:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263467.872510:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.872526:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.872538:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263467.872944:0:14497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788263467.872955:0:14497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 494660737064ns, next at 495660734466ns, rc = 0 00000004:00010000:3.0:1788263467.873062:0:14497:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b11403f reply state 000000002e1a023f transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.873072:0:14497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263467.873190:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+29:14500:x1875129735963392:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 765us (1092us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788263467.873197:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:0.0:1788263467.876116:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:1.0:1788263467.876234:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.876247:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.876254:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.876260:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263467.876264:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.876271:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.876288:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:1.0:1788263467.876290:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788263467.876295:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.876300:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957179 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.876396:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735963520 00000100:00100000:2.0:1788263467.876405:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735963520 00000100:00100000:2.0:1788263467.876456:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:2.0:1788263467.876466:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+28:14500:x1875129735963520:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263467.876488:0:14499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263467.876503:0:14499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3552 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.876559:0:14499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3552 expref: 29 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.876585:0:14499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3552 expref: 29 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.876607:0:14499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:2.0:1788263467.876610:0:14499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263467.876613:0:14499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d7400, rc 0) 00000100:00100000:2.0:1788263467.876664:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+29:14500:x1875129735963520:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 199us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.876671:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:0.0:1788263467.880003:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.880086:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735963648 00000100:00100000:1.0:1788263467.880097:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735963648 00000100:00100000:1.0:1788263467.880168:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788263467.880179:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2362:x1875129735963648:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788263467.880595:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+6:2362:x1875129735963648:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 415us (600us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788263467.880603:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788263467.883540:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.883640:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735963904 00000100:00100000:1.0:1788263467.883650:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735963904 00000100:00100000:1.0:1788263467.883711:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1788263467.883722:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+29:14500:x1875129735963904:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788263467.883963:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+30:14500:x1875129735963904:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 241us (431us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788263467.883971:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263467.886016:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.886096:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735964160 00000100:00100000:3.0:1788263467.886105:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735964160 00000100:00100000:3.0:1788263467.886170:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:3.0:1788263467.886181:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+30:14500:x1875129735964160:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788263467.886336:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+30:14500:x1875129735964160:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 156us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.886343:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:0.0:1788263467.888639:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.888737:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735964288 00000100:00100000:1.0:1788263467.888746:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735964288 00000100:00100000:1.0:1788263467.888800:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1788263467.888811:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+30:14500:x1875129735964288:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263467.888832:0:14498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263467.888854:0:14498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898800/0x1a657bc513957187 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3559 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.888933:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898200/0x1a657bc51395718e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.888963:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242898200/0x1a657bc51395718e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.888989:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898200/0x1a657bc51395718e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263467.889029:0:14498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788263467.889048:0:14498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994242898200/0x1a657bc51395718e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.889075:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898800/0x1a657bc513957187 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3559 expref: 32 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.889093:0:14498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898200/0x1a657bc51395718e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3559 expref: 31 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.889101:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:1.0:1788263467.889103:0:14498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788263467.889106:0:14498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898200, rc 0) 00000100:00100000:1.0:1788263467.889173:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+31:14500:x1875129735964288:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 364us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.889181:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:0.0:1788263467.892549:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263467.892656:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735964416 00000100:00100000:2.0:1788263467.892667:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735964416 00000100:00100000:2.0:1788263467.892723:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1788263467.892734:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+6:2361:x1875129735964416:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263467.892751:0:15184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263467.892773:0:15184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3560 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263467.892801:0:15184:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bc2b, blocks: 0x1 00010000:00010000:2.0:1788263467.892820:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788263467.892825:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263467.892835:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3560 expref: 7 pid: 15184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.892853:0:15184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3560 expref: 7 pid: 15184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.892886:0:15184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9943810d6e00, rc 0) 00000100:00100000:2.0:1788263467.892949:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+7:2361:x1875129735964416:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 216us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.892957:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1788263467.896059:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263467.896288:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735964672 00000100:00100000:2.0:1788263467.896299:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735964672 00000100:00100000:2.0:1788263467.896360:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1788263467.896371:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+31:14500:x1875129735964672:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788263467.896481:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+31:14500:x1875129735964672:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 111us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.896489:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:0.0:1788263467.899345:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.899607:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735964800 00000100:00100000:3.0:1788263467.899616:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735964800 00000100:00100000:2.0:1788263467.899792:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:2.0:1788263467.899803:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+31:14500:x1875129735964800:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788263467.928121:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+31:14500:x1875129735964800:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 28301us (28766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.928135:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000001:00080000:2.0:1788263467.928180:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1788263467.928207:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:2.0:1788263467.928284:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788263467.928530:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263467.928547:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753771008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788263467.928605:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263467.931844:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.932017:0:16378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753771008 00000100:00100000:3.0:1788263467.932027:0:16378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753771008 00000100:00100000:0.0:1788263467.932204:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735964928 00000100:00100000:0.0:1788263467.932244:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735964928 00000100:00100000:0.0:1788263467.932277:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263467.932287:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753771008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788263467.932479:0:15184:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788263467.932483:0:15184:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788263467.932485:0:15184:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788263467.932488:0:15184:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788263467 -> 1788263467 00002000:00010000:0.0:1788263467.932491:0:15184:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788263467.932619:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875129753771008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 333us (4013us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788263467.932629:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263467.932650:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788263467.932658:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+7:2362:x1875129735964928:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788263467.932716:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+7:2362:x1875129735964928:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 58us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.932723:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000004:00080000:0.0:1788263467.934011:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994381290000/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788263467.934043:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753771008:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788263467.935520:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263467.939526:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263467.939681:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735965184 00000100:00100000:2.0:1788263467.939693:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735965184 00000100:00100000:2.0:1788263467.939759:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:2.0:1788263467.939770:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+14:14500:x1875129735965184:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788263467.939842:0:14498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263467.939871:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898200/0x1a657bc51395718e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3559 expref: 14 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.939891:0:14498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:2.0:1788263467.939896:0:14498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263467.939924:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.939938:0:14498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.939947:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263467.940156:0:14498:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3466b66 reply state 000000006a93933b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.940166:0:14498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263467.940317:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+15:14500:x1875129735965184:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 548us (809us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788263467.940324:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00010000:00010000:2.0:1788263467.948448:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.948468:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.948474:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.948498:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263467.948503:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.948522:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.948541:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:2.0:1788263467.948544:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263467.948548:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.948555:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc51395719c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263467.950288:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263467.950721:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735965312 00000100:00100000:0.0:1788263467.950730:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735965312 00000100:00100000:0.0:1788263467.950889:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788263467.950901:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994346b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+7:14500:x1875129735965312:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263467.950922:0:15184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263467.950943:0:15184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3567 expref: -99 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.950979:0:15184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3560 expref: 8 pid: 15184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.950989:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263467.950993:0:15184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263467.950999:0:15184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 8 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.951035:0:15184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3560 expref: 8 pid: 15184 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.951050:0:15184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3560 expref: 8 pid: 15184 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263467.951066:0:15184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381292d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15184:1875129753771136:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263467.951162:0:15184:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437217c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.958622:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.958762:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735965440 00000100:00100000:1.0:1788263467.958782:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735965440 00010000:00010000:1.0:1788263467.958840:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3560 expref: 9 pid: 15184 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263467.958882:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788263467.958893:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+9:2361:x1875129735965440:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263467.958908:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263467.958931:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3560 expref: 9 pid: 15184 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.958946:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3560 expref: 9 pid: 15184 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.958984:0:14483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263467.958990:0:14483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263467.958997:0:14483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 9 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.959009:0:14483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 9 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.959051:0:14483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 9 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263467.959077:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14483:1875129753771264:192.168.201.29@tcp:105: 00000100:00100000:1.0:1788263467.959169:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff994377a87240 going to sleep for 11 seconds 00010000:00010000:2.0:1788263467.960268:0:15184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc513957195 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3560 expref: 9 pid: 15184 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.960290:0:15184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381292d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15184:1875129753771136:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263467.960319:0:15184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 8 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.960332:0:15184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382043e00, rc 0) 00000100:00100000:2.0:1788263467.960377:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994346b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+8:14500:x1875129735965312:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 9478us (10099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.960387:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:1.0:1788263467.964759:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14483:1875129753771264:192.168.201.29@tcp:105: 00010000:00010000:1.0:1788263467.964796:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263467.964854:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+7:2361:x1875129735965440:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 5961us (6241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.964866:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788263467.970332:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.970496:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735965568 00000100:00100000:3.0:1788263467.970514:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735965568 00000100:00100000:3.0:1788263467.970579:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788263467.970590:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+7:2362:x1875129735965568:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788263467.970983:0:15182:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788263467.970987:0:15182:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788263467 00002000:00010000:3.0:1788263467.970990:0:15182:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788263466 00002000:00010000:3.0:1788263467.970992:0:15182:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788263467 -> 1788263467 00002000:00010000:3.0:1788263467.970995:0:15182:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788263467.971058:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+8:2362:x1875129735965568:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 469us (945us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788263467.971090:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788263467.975064:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.975284:0:16378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735965696 00000100:00100000:3.0:1788263467.975294:0:16378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735965696 00000100:00100000:3.0:1788263467.975355:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1788263467.975366:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+8:2359:x1875129735965696:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788263467.975413:0:16378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.975436:0:16378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 8 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.975444:0:16378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263467.975449:0:16378:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263467.975453:0:16378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.975488:0:16378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 8 pid: 15184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.975502:0:16378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 8 pid: 15184 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.975651:0:16378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16378:1875129753771392:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263467.975796:0:16378:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcce0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263467.978878:0:16378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16378:1875129753771392:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263467.978927:0:16378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263467.981048:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263467.981678:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735965824 00000100:00100000:3.0:1788263467.981689:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735965824 00010000:00010000:3.0:1788263467.981729:0:14484:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 9 pid: 15184 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.981774:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1788263467.981785:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+9:2361:x1875129735965824:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263467.981801:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263467.981825:0:14484:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 9 pid: 15184 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.981840:0:14484:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 9 pid: 15184 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.981867:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac2cc3e2/0x1a657bc5139571a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3567 expref: 9 pid: 15184 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.981886:0:14484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263467.981890:0:14484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263467.981897:0:14484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.981908:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.981961:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263467.982034:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381292300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+8:2361:x1875129735965824:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 250us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.982042:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00010000:00010000:2.0:1788263467.982814:0:16378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.982838:0:16378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.982866:0:16378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.982875:0:16378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.982884:0:16378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.982892:0:16378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263467.982896:0:16378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.982905:0:16378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.982921:0:16378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.982929:0:16378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ee72f99/0x1a657bc5139571aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.983017:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+7:2359:x1875129735965696:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 7650us (7972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.983025:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:0.0:1788263467.991042:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263467.991137:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735966080 00000100:00100000:2.0:1788263467.991147:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735966080 00000100:00100000:2.0:1788263467.991258:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:2.0:1788263467.991271:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+14:14500:x1875129735966080:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788263467.991353:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.991372:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.991387:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.991646:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.991658:0:14497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3552 expref: 15 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.991666:0:14497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.991700:0:14497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3552 expref: 15 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.991728:0:14497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3552 expref: 15 pid: 14499 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.991745:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14497:1875129753771520:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263467.991832:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943469f7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.995136:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263467.995283:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735966208 00000100:00100000:1.0:1788263467.995292:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735966208 00010000:00010000:1.0:1788263467.995332:0:14483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3552 expref: 16 pid: 14499 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263467.995375:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788263467.995386:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+16:2362:x1875129735966208:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263467.995402:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263467.995409:0:14483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3552 expref: 16 pid: 14499 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.995424:0:14483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3552 expref: 16 pid: 14499 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.995447:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:1.0:1788263467.995451:0:14483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.995462:0:14483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.995470:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.995520:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263467.995580:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+16:2362:x1875129735966208:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 196us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.995588:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:2.0:1788263467.996038:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc513957180 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3552 expref: 15 pid: 14499 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.996072:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14497:1875129753771520:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263467.996094:0:14497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.996103:0:14497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.996117:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263467.996360:0:14497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788263467.996494:0:14497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788263467.996876:0:14497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788263467.996963:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14497:1875129753771648:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788263467.997253:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.997328:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943438f83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263467.998821:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753771648 00000100:00100000:1.0:1788263467.998833:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753771648 00000100:00100000:1.0:1788263467.998958:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263467.998983:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14497:x1875129753771648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788263467.999300:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14497:1875129753771648:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788263468.000030:0:14497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788263468.000136:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14497:1875129753771776:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788263468.000844:0:14497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263468.001282:0:14503:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788263468.001542:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffff994355c9a6c0 going to sleep for 10 seconds 00000100:00100000:1.0:1788263468.001682:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14497:x1875129753771648:12345-0@lo:1000:mdt00_000.0 Request processed in 2710us (4426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263468.001694:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263468.001740:0:14503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788263468.001939:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753771776 00000100:00100000:1.0:1788263468.001948:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753771776 00000100:00100000:1.0:1788263468.002318:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263468.002328:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14497:x1875129753771776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788263468.002611:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14497:x1875129753771776:12345-0@lo:1000:mdt00_000.0 Request processed in 284us (1769us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788263468.002618:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263468.003462:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14497:1875129753771776:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788263468.003504:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003582:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003589:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003594:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263468.003599:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003606:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003624:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:2.0:1788263468.003627:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263468.003631:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003636:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6e00/0x1a657bc5139571b8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003670:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003677:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003692:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003698:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263468.003700:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003706:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003714:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:2.0:1788263468.003717:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263468.003725:0:14497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513957117 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3536 expref: 18 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003736:0:14497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513957117 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3536 expref: 18 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003745:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513957117 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3536 expref: 18 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.003780:0:14497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513957117 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3536 expref: 18 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263468.003795:0:14497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14497:1875129753771904:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788263468.003885:0:14497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943469f7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788263468.008629:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263468.008724:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735966336 00000100:00100000:1.0:1788263468.008734:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735966336 00000100:00100000:1.0:1788263468.008847:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788263468.008860:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994374437c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+19:14499:x1875129735966336:12345-192.168.201.29@tcp:49:dd.0 00000100:00100000:1.0:1788263468.008995:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994374437c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+19:14499:x1875129735966336:12345-192.168.201.29@tcp:49:dd.0 Request processed in 138us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263468.009003:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00080000:0.0:1788263468.009090:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263468.009149:0:14497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14497:1875129753771904:192.168.201.29@tcp:105: 00010000:00010000:2.0:1788263468.009181:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009192:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc513957110 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009253:0:14497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009268:0:14497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009278:0:14497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009287:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009293:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009298:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009303:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263468.009307:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009314:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009325:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:2.0:1788263468.009333:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263468.009338:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009343:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7400/0x1a657bc5139571bf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009354:0:14497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009360:0:14497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009365:0:14497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009369:0:14497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263468.009371:0:14497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009376:0:14497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009383:0:14497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:2.0:1788263468.009385:0:14497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788263468.009388:0:14497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.009392:0:14497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7e00/0x1a657bc5139571b1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263468.009605:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+18:14500:x1875129735966080:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 18336us (18575us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788263468.009624:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000020:00080000:2.0:1788263468.009629:0:14497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788263468.009857:0:14531:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788263468.009863:0:14531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263468.009888:0:14531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788263468.009894:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788263468.024037:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263468.024128:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735966592 00000100:00100000:3.0:1788263468.024137:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735966592 00000100:00100000:3.0:1788263468.024199:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788263468.024240:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+18:14500:x1875129735966592:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788263468.025707:0:14501:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788263468.025815:0:14501:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788263468.025956:0:14501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.025975:0:14501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.025988:0:14501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.025997:0:14501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.026004:0:14501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.026021:0:14501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.026083:0:14501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788263468.026245:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+20:14500:x1875129735966592:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1995us (2327us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788263468.026255:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000020:00080000:0.0:1788263468.026262:0:14501:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788263468.026987:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263468.026998:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.027007:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382042000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263468.027012:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.027020:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.027036:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:2.0:1788263468.027039:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788263468.027044:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.027050:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994382042000/0x1a657bc5139571c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.027065:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263468.027067:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263468.027069:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263468.189869:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263468.189927:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263468.190021:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735966720 00000100:00100000:2.0:1788263468.190030:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735966720 00000100:00100000:2.0:1788263468.190100:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735966848 00000100:00100000:2.0:1788263468.190104:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735966848 00000100:00100000:2.0:1788263468.190134:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788263468.190144:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+8:2361:x1875129735966720:12345-192.168.201.29@tcp:4:dd.0 00002000:00010000:2.0:1788263468.190243:0:15187:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a96bc2b, atime: 0x6a96bc2a, ctime: 0x6a96bc2b, blocks: 0x1 00010000:00010000:2.0:1788263468.190253:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.190270:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=494s v=(0 0) 00010000:00010000:2.0:1788263468.190274:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263468.190280:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.190296:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788263468.191730:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263468.198013:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263468.198152:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263468.198479:0:15188:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788263468.198491:0:15188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788263468.199145:0:15189:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788263468.199163:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735967104 00000100:00100000:3.0:1788263468.199171:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735967104 00000100:00100000:3.0:1788263468.199257:0:15189:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788263468.199263:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735966976 00000100:00100000:3.0:1788263468.199266:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735966976 00000100:00100000:2.0:1788263468.199353:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263468.199436:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263468.199449:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263468.199461:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263468.199878:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735967360 00000100:00100000:2.0:1788263468.199882:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735967360 00000100:00100000:2.0:1788263468.199979:0:15188:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788263468.199983:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735967232 00000100:00100000:2.0:1788263468.199985:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735967232 00000100:00100000:2.0:1788263468.199994:0:15188:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788263468.199997:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735967488 00000100:00100000:2.0:1788263468.199998:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735967488 00000100:00100000:2.0:1788263468.200004:0:15188:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788263468.200006:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735967616 00000100:00100000:2.0:1788263468.200008:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735967616 00000100:00100000:1.0:1788263468.200652:0:16732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:1.0:1788263468.200664:0:16732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+15:2361:x1875129735966848:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:1.0:1788263468.200700:0:16732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.200717:0:16732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263468.200722:0:16732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263468.200728:0:16732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.200743:0:16732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263468.290238:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753772416:0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.290325:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263468.290381:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788263468.290387:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753772288:0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.290412:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263468.290430:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753772800:0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.290457:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263468.290488:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753772416 00000100:00100000:2.0:1788263468.290496:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753772416 00000100:00100000:2.0:1788263468.291056:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753772288 00000100:00100000:2.0:1788263468.291061:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753772288 00000100:00100000:2.0:1788263468.291083:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263468.291091:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753772416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.291241:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753772416:12345-0@lo:400:kworker.0 Request processed in 149us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263468.291248:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263468.291265:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788263468.291271:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753772288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.291300:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753772288:12345-0@lo:400:kworker.0 Request processed in 29us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263468.291306:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788263468.291344:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753772288:0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.291354:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753772416:0@lo:400:kworker.0 00000100:00080000:2.0:1788263468.294253:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263468.294288:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753772160:0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.294359:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263468.294468:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753772672:0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.294498:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263468.294538:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788263468.294545:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753772032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263468.294574:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263468.294593:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753772544:0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.294614:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263468.294640:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753772032 00000100:00100000:2.0:1788263468.294647:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753772032 00000100:00100000:2.0:1788263468.294691:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263468.294700:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753772032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263468.294738:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263468.294784:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753772032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263468.294790:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263468.294837:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753772032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263468.294863:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753772800 00000100:00100000:2.0:1788263468.294867:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753772800 00000100:00080000:2.0:1788263468.295383:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263468.295407:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753772672 00000100:00100000:2.0:1788263468.295412:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753772672 00000100:00080000:2.0:1788263468.295424:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263468.295436:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753772544 00000100:00100000:2.0:1788263468.295439:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753772544 00000100:00100000:2.0:1788263468.295454:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263468.295460:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753772800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.295569:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753772800:12345-0@lo:400:kworker.0 Request processed in 108us (5111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263468.295586:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263468.295623:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753772800:0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.295648:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263468.295655:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753772672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.295691:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753772672:12345-0@lo:400:kworker.0 Request processed in 36us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263468.295697:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263468.295722:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753772672:0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.295742:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263468.295749:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753772544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263468.295782:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753772544:12345-0@lo:400:kworker.0 Request processed in 34us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263468.295788:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263468.295812:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753772544:0@lo:400:kworker.0 00000100:00100000:3.0:1788263468.296344:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753772160 00000100:00100000:3.0:1788263468.296351:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753772160 00000100:00100000:3.0:1788263468.296397:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788263468.296406:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753772160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263468.296457:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753772160:12345-0@lo:400:kworker.0 Request processed in 53us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263468.296464:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788263468.296657:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753772160:0@lo:400:kworker.0 00000001:00080000:1.0:1788263468.324902:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1788263468.324930:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1788263468.324935:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:1.0:1788263468.324941:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1788263468.325186:0:15187:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788263468.325192:0:15187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788263468.325590:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.325629:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.325639:0:15187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.325646:0:15187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263468.325651:0:15187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.325661:0:15187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.325684:0:15187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.325692:0:15187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090836742/0x1a657bc5139571cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263468.325793:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+15:2361:x1875129735966720:12345-192.168.201.29@tcp:4:dd.0 Request processed in 135646us (135928us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788263468.325803:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263468.325837:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1788263468.325851:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+14:2362:x1875129735967104:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:3.0:1788263468.326375:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.326397:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788263468.326401:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263468.326407:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.326419:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.349490:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788263468.384774:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1788263468.387305:0:16732:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:2.0:1788263468.387315:0:16732:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:2.0:1788263468.387331:0:16732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.387346:0:16732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.387369:0:16732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.387377:0:16732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263468.387382:0:16732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.387390:0:16732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.387410:0:16732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.387417:0:16732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263468.387534:0:16732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+14:2361:x1875129735966848:12345-192.168.201.29@tcp:4:dd.0 Request processed in 186865us (197599us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788263468.387545:0:16732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1788263468.387585:0:16732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788263468.387598:0:16732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+13:2362:x1875129735966976:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788263468.387636:0:16732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.387650:0:16732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263468.387661:0:16732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263468.387667:0:16732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.387679:0:16732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263468.453684:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:2.0:1788263468.454310:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.454329:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.454340:0:15187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.454349:0:15187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263468.454355:0:15187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.454365:0:15187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.454392:0:15187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.454401:0:15187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c793137/0x1a657bc5139571db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263468.454549:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+13:2362:x1875129735967104:12345-192.168.201.29@tcp:4:dd.0 Request processed in 128693us (256538us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788263468.454560:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788263468.454605:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788263468.454622:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+12:2362:x1875129735967360:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788263468.454668:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.454683:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263468.454689:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263468.454697:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.454711:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263468.523362:0:16732:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1788263468.523376:0:16732:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1788263468.523395:0:16732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.523437:0:16732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.523447:0:16732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.523455:0:16732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263468.523460:0:16732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.523470:0:16732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.523497:0:16732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.523517:0:16732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186f1bcc/0x1a657bc5139571e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263468.523640:0:16732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+14:2362:x1875129735966976:12345-192.168.201.29@tcp:4:dd.0 Request processed in 136038us (325479us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788263468.523652:0:16732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1788263468.523697:0:16732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788263468.523711:0:16732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+13:2362:x1875129735967232:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:1.0:1788263468.523753:0:16732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.523774:0:16732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263468.523780:0:16732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263468.523788:0:16732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.523802:0:16732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263468.523952:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:1.0:1788263468.582427:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1788263468.582762:0:15187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1788263468.582785:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.582801:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.582812:0:15187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.582821:0:15187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263468.582827:0:15187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.582837:0:15187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.582866:0:15187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.582897:0:15187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005127fccc/0x1a657bc5139571e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263468.583033:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+11:2362:x1875129735967360:12345-192.168.201.29@tcp:4:dd.0 Request processed in 128411us (383674us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788263468.583053:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1788263468.583269:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788263468.583300:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+10:2361:x1875129735967488:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:0.0:1788263468.583348:0:15187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.583363:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263468.583368:0:15187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263468.583493:0:15187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263468.583509:0:15187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263468.657488:0:16732:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1788263468.657512:0:16732:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1788263468.657533:0:16732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.657547:0:16732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.657557:0:16732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.657565:0:16732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263468.657571:0:16732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.657580:0:16732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.657625:0:16732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.657633:0:16732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa43e1f2/0x1a657bc5139571f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263468.657763:0:16732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+12:2362:x1875129735967232:12345-192.168.201.29@tcp:4:dd.0 Request processed in 134049us (458319us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788263468.657774:0:16732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788263468.657822:0:16732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788263468.657836:0:16732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+11:2362:x1875129735967616:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:1.0:1788263468.657882:0:16732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.657896:0:16732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263468.657901:0:16732:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263468.657908:0:16732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.657922:0:16732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263468.661484:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:3.0:1788263468.789109:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1788263468.789302:0:15187:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788263468.789309:0:15187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788263468.789328:0:15187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.789341:0:15187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.789351:0:15187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.789382:0:15187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994382042c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263468.789389:0:15187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.789398:0:15187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.789424:0:15187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263468.789432:0:15187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003362795c/0x1a657bc5139571f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263468.794073:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+9:2361:x1875129735967488:12345-192.168.201.29@tcp:4:dd.0 Request processed in 210772us (594601us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788263468.794204:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000001:00080000:0.0:1788263468.958662:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1788263468.964312:0:16732:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788263468.964344:0:16732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.964359:0:16732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.964369:0:16732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.964377:0:16732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263468.964383:0:16732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.964393:0:16732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.964444:0:16732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.964453:0:16732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018fd50ac/0x1a657bc5139571fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263468.964617:0:16732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2362:x1875129735967616:12345-192.168.201.29@tcp:4:dd.0 Request processed in 306778us (765146us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788263468.964630:0:16732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00010000:00010000:2.0:1788263469.372407:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263470.332503:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263470.332528:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753772928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263470.332600:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263470.332678:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753772928 00000100:00100000:0.0:1788263470.332687:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753772928 00000100:00100000:0.0:1788263470.332762:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263470.332773:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753772928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263470.332825:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788263470.332875:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753772928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263470.332883:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788263470.332904:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263470.332933:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788263470.332939:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff994381290000, transno 8589934595 00000004:00080000:0.0:1788263470.332949:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788263470.332976:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753772928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263470.397545:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263470.788922:0:16770:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:2.0:1788263471.099733:0:14531:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788263471.099744:0:14531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263471.099782:0:14531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788263471.099788:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788263471.419486:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263471.856684:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263471.856714:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263471.856732:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263471.856751:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263471.856762:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263471.856772:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263471.856793:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263471.856813:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735968128 00000100:00100000:0.0:1788263471.856821:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735968128 00000100:00100000:0.0:1788263471.856856:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735968384 00000100:00100000:0.0:1788263471.856858:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735968384 00000100:00100000:0.0:1788263471.856866:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735968000 00000100:00100000:0.0:1788263471.856867:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735968000 00000100:00100000:0.0:1788263471.856876:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735968512 00000100:00100000:0.0:1788263471.856877:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735968512 00000100:00100000:0.0:1788263471.856887:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:0.0:1788263471.856900:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735968128:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263471.856956:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735968128:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.856960:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:0.0:1788263471.856972:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1788263471.856976:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2360:x1875129735968384:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263471.856988:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2360:x1875129735968384:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 12us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.856992:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1788263471.856997:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1788263471.857000:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735968000:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263471.857011:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735968000:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 10us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.857014:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1788263471.857019:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:0.0:1788263471.857022:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2360:x1875129735968512:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263471.857032:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2360:x1875129735968512:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 9us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.857035:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:0.0:1788263471.857046:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735967744 00000100:00100000:0.0:1788263471.857048:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735967744 00000100:00100000:0.0:1788263471.857061:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:0.0:1788263471.857065:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2360:x1875129735967744:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263471.857096:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2360:x1875129735967744:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.857103:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00080000:0.0:1788263471.857137:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263471.857152:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263471.857386:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735967872 00000100:00100000:1.0:1788263471.857396:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735967872 00000100:00100000:1.0:1788263471.857584:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735968256 00000100:00100000:1.0:1788263471.857589:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735968256 00000100:00100000:1.0:1788263471.857605:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1788263471.857612:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+20:2360:x1875129735967872:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263471.857647:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+20:2360:x1875129735967872:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263471.857654:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1788263471.857669:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:1.0:1788263471.857675:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2360:x1875129735968256:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263471.857699:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2360:x1875129735968256:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263471.857705:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00080000:0.0:1788263471.857927:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788263472.447249:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29285 lines, 29285 kept, 0 dropped, 0 bad.